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Chapter 1 

Statistical Complexity and Fisher-Shannon 
Information. Applications 



Abstract In this chapter, a statistical measure of complexity and the Fisher-Shannon 
information product are introduced and their properties are discussed. These mea- 
sures are based on the interplay between the Shannon information, or a function of 
it, and the separation of the set of accessible states to a system from the equiprob- 
ability distribution, i.e. the disequilibrium or the Fisher information, respectively. 
Different applications in discrete and continuous systems are shown. Some of them 
are concerned with quantum systems, from prototypical systems such as the H-atom, 
the harmonic oscillator and the square well to other ones such as He-like ions, 
Hooke's atoms or just the periodic table. In all of them, these statistical indicators 
show an interesting behavior able to discern and highlight some conformational 
properties of those systems. 
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1 Statistical Complexity and Fisher-Shannon Information. Applications 



1.1 A Statistical Measure of Complexity. Some Applications 

This century has been told to be the century of complexity (TJ. Nowadays the ques- 
tion "what is complexity?" is circulating over the scientific crossroads of physics, 
biology, mathematics and computer science, although under the present understand- 
ing of the world could be no urgent to answer this question. However, many different 
points of view have been developed to this respect and hence a lot of different an- 
swers can be found in the literature. Here we explain in detail one of these options. 

On the most basic grounds, an object, a procedure, or system is said to be "com- 
plex" when it does not match patterns regarded as simple. This sounds rather like 
an oxymoron but common knowledge tells us what is simple and complex: simpli- 
fied systems or idealizations are always a starting point to solve scientific problems. 
The notion of "complexity" in physics (HE] starts by considering the perfect crystal 
and the isolated ideal gas as examples of simple models and therefore as systems 
with zero "complexity". Let us briefly recall their main characteristics with "order", 
"information" and "equilibrium". 

A perfect crystal is completely ordered and the atoms are arranged following 
stringent rules of symmetry. The probability distribution for the states accessible to 
the perfect crystal is centered around a prevailing state of perfect symmetry. A small 
piece of "information" is enough to describe the perfect crystal: the distances and the 
symmetries that define the elementary cell. The "information" stored in this system 
can be considered minimal. On the other hand, the isolated ideal gas is completely 
disordered. The system can be found in any of its accessible states with the same 
probability. All of them contribute in equal measure to the "information" stored in 
the ideal gas. It has therefore a maximum "information". These two simple systems 
are extrema in the scale of "order" and "information". It follows that the definition 
of "complexity" must not be made in terms of just "order" or "information". 

It might seem reasonable to propose a measure of "complexity" by adopting 
some kind of distance from the equiprobable distribution of the accessible states of 
the system. Defined in this way, "disequilibrium" would give an idea of the prob- 
abilistic hierarchy of the system. "Disequilibrium" would be different from zero if 
there are privileged, or more probable, states among those accessible. But this would 
not work. Going back to the two examples we began with, it is readily seen that a 
perfect crystal is far from an equidistribution among the accessible states because 
one of them is totally prevailing, and so "disequilibrium" would be maximum. For 
the ideal gas, "disequilibrium" would be zero by construction. Therefore such a dis- 
tance or "disequilibrium" (a measure of a probabilistic hierarchy) cannot be directly 
associated with "complexity". 

In Figure fTTI we sketch an intuitive qualitative behavior for "information" H and 
"disequilibrium" D for systems ranging from the perfect crystal to the ideal gas. This 
graph suggests that the product of these two quantities could be used as a measure 
of "complexity": C = H D. The function C has indeed the features and asyntotical 
properties that one would expect intuitively: it vanishes for the perfect crystal and 
for the isolated ideal gas, and it is different from zero for the rest of the systems 
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of particles. We will follow these guidelines to establish a quantitative measure of 
"complexity". 

Before attempting any further progress, however, we must recall that "complex- 
ity" cannot be measured univocally, because it depends on the nature of the descrip- 
tion (which always involves a reductionist process) and on the scale of observation. 
Let us take an example to illustrate this point. A computer chip can look very differ- 
ent at different scales. It is an entangled array of electronic elements at microscopic 
scale but only an ordered set of pins attached to a black box at a macroscopic scale. 




Fig. 1.1 Sketch of the intuitive notion of the magnitudes of "information" (H) and "disequilibrium" 
(D) for the physical systems and the behavior intuitively required for the magnitude "complexity". 
The quantity C = H ■ D is proposed to measure such a magnitude. 



We shall now discuss a measure of "complexity" based on the statistical descrip- 
tion of systems. Let us assume that the system has N accessible states {x\,xi, ...,xn} 
when observed at a given scale. We will call this an A^-system. Our understanding of 
the behavior of this system determines the corresponding probabilities {pi,P2, • ■•,/>#} 
(with the condition Y!i=\ Pi = 1) of each state (pi > for all i). Then the knowledge 
of the underlying physical laws at this scale is incorporated into a probability dis- 
tribution for the accessible states. It is possible to find a quantity measuring the 
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amount of "information". Under to the most elementary conditions of consistency, 
Shannon B determined the unique function H(p\,p2, ■■■,Pn) that accounts for the 
"information" stored in a system: 

N 

ff = iog/>;, (i.i) 

where K is a positive constant. The quantity H is called information. The redefini- 
tion of information H as some type of monotone function of the Shannon entropy 
can be also useful in many contexts as we shall show in the next sections. In the 
case of a crystal, a state x c would be the most probable p c ~ 1, and all others Xj 
would be very improbable, pt ~ i : ^ c. Then H c ~ 0. On the other side, equiprob- 
ability characterizes an isolated ideal gas, p, ~ 1 /N so H g ~ KlogN, i.e., the max- 
imum of information for a N-system. (Notice that if one assumes equiprobability 
and K = k = Boltzmann constant, H is identified with the thermodinamic entropy, 
S = KlogN). Any other N-system will have an amount of information between those 
two extrema. 

Let us propose a definition of disequilibrium D in a A^-system Q. The intuitive 
notion suggests that some kind of distance from an equiprobable distribution should 
be adopted. Two requirements are imposed on the magnitude of D: D > in order to 
have a positive measure of "complexity" and D = on the limit of equiprobability. 
The straightforward solution is to add the quadratic distances of each state to the 
equiprobability as follows: 

N / ,\2 

D= • (L2) 

According to this definition, a crystal has maximum disequilibrium (for the dom- 
inant state, p c 1, and D c 1 for N — s- °°) while the disequilibrium for an ideal 
gas vanishes (D g ~ 0) by construction. For any other system D will have a value 
between these two extrema. 

We now introduce the definition of complexity C of a A^-system J6] |7). This is 
simply the interplay between the information stored in the system and its disequi- 
librium: 

C = HD = - ^f^logPiV (£(a-^) J. (1-3) 

This definition fits the intuitive arguments. For a crystal, disequilibrium is large but 
the information stored is vanishingly small, so C ~ 0. On the other hand, H is large 
for an ideal gas, but D is small, so C ~ as well. Any other system will have an 
intermediate behavior and therefore C > 0. 

As was intuitively suggested, the definition of complexity ( 11.31 l also depends on 
the scale. At each scale of observation a new set of accessible states appears with its 
corresponding probability distribution so that complexity changes. Physical laws at 
each level of observation allow us to infer the probability distribution of the new set 
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of accessible states, and therefore different values for H, D and C will be obtained. 
The straightforward passage to the case of a continuum number of states, x, can be 
easily inferred. Thus we must treat with probability distributions with a continuum 
support, p(x), and normalization condition f^™ p(x)dx = 1. Disequilibrium has the 
limit D = f^™ p 2 (x)dx and the complexity could be defined by: 

C = H D = -(k J + p(x)logp(x)dxj ■ (j + p 2 {x)dx^j . (1.4) 

As we shall see, other possibilities for the continuous extension of C are also possi- 
ble. 
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Fig. 1.2 In general, dependence of complexity (C) on normalized information (H) is not univocal: 
many distributions {p,} can present the same value of H but different C. This is shown in the case 
N = 3. 



Direct simulations of the definition give the values of C for general A-systems. 
The set of all the possible distributions {p\,p2, • where an A^-system could be 

found is sampled. For the sake of simplicity H is normalized to the interval [0,1]. 
Thus H = L^i/'i'log/'i/log^V '. For each distribution {/?,} the normalized informa- 
tion H({pi}), and the disequilibrium £)({/?,}) (eq. |1.2t are calculated. In each case 
the normalized complexity C = H ■ D is obtained and the pair (H,C) stored. These 
two magnitudes are plotted on a diagram (H, C(H) ) in order to verify the qualitative 
behavior predicted in Figure 11.11 For N = 2 an analytical expression for the curve 
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C(H) is obtained. If the probability of one state is p\ = x, that of the second one is 
simply /?2 = 1 — x. The complexity of the system will be: 

C(x)=H(x)-D(x) = -^[xlog(-^+log(l-x))-2(x-^j . (1.5) 

Complexity vanishes for the two simplest 2-systems: the crystal (H = 0; p\ = 1, 
P2 = 0) and the ideal gas (H = 1; p\ = 1 /2, p2 = 1 /2). Let us notice that this curve 
is the simplest one that fulfills all the conditions discussed in the introduction. The 
largest complexity is reached for H ~ 1/2 and its value is: C(x ~ 0.11) ~ 0.151. 
For N > 2 the relationship between H and C is not univocal anymore. Many differ- 
ent distributions {/?,} store the same information H but have different complexity 
C. Figure [L2l displays such a behavior for N = 3. If we take the maximum com- 
plexity C max {H) associated with each H a curve similar to the one for a 2-system is 
recovered. Every 3-system will have a complexity below this line and upper the line 
°f C m i n (H) and also upper the minimum envelope complexity C m i nen v These lines 
will be analytically found in a next section. In Figure [T31 curves C max (H) for the 
cases = 3, . . . , 10 are also shown. Let us observe the shift of the complexity-curve 
peak to smaller values of entropy for rising N. This fact agrees with the intuition 
telling us that the biggest complexity (number of possibilities of 'complexification') 
be reached for lesser entropies for the systems with bigger number of states. 
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Let us return to the point at which we started this discussion. Any notion of 
complexity in physics 12 [3) should only be made on the basis of a well defined or 
operational magnitude |6|[7). But two additional requirements are needed in order 
to obtain a good definition of complexity in physics: (1) the new magnitude must be 
measurable in many different physical systems and (2) a comparative relationship 
and a physical interpretation between any two measurements should be possible. 

Many different definitions of complexity have been proposed to date, mainly 
in the realm of physical and computational sciences. Among these, several can be 
cited: algorithmic complexity (Kolmogorov-Chaitin) J8][9]], the Lempel-Ziv com- 
plexity iflOl . the logical depth of Bennett ifTTl . the effective measure complexity of 
Grassberger lfl2l . the complexity of a system based in its diversity |[T3l . the thermo- 
dynamical depth lfT4l . the e-machine complexity lfl"5l , the physical complexity of 
genomes lfl6l . complexities of formal grammars, etc. The definition of complexity 
( 11.31 ) proposed in this section offers a new point of view, based on a statistical de- 
scription of systems at a given scale. In this scheme, the knowledge of the physical 
laws governing the dynamic evolution in that scale is used to find its accessible states 
and its probability distribution. This process would immediately indicate the value 
of complexity. In essence this is nothing but an interplay between the information 
stored by the system and the distance from equipartition (measure of a probabilistic 
hierarchy between the observed parts) of the probability distribution of its accessi- 
ble states. Besides giving the main features of a "intuitive" notion of complexity, 
we will show in this chapter that we can go one step further and to compute this 
quantity in other relevant physical situations and in continuum systems. The most 
important point is that the new definition successfully enables us to discern situa- 
tions regarded as complex. For example, we show here two of these applications in 
complex systems with some type of discretization: one of them is the study of this 
magnitude in a phase transition in a coupled map lattice 1 17| and the other one is 
its calculation for the time evolution of a discrete gas out of equilibrium IT8l . Other 
applications to more realistic systems can also be found in the literature 1191 . 



1.1.1 Complexity in a phase transition: coupled map lattices 

If by complexity it is to be understood that property present in all systems attached 
under the epigraph of 'complex systems', this property should be reasonably quanti- 
fied by the measures proposed in the different branches of knowledge. As discussed 
above, this kind of indicators is found in those fields where the concept of informa- 
tion is crucial, from physics lfT2l[l4l to computational sciences ll8l l9l [Tol IT31 . 

In particular, taking into account the statistical properties of a system, the indi- 
cator called the LMC (LopezRuiz-Mancini-Calbet) complexity has been introduced 
J6] I3 in the former section. This magnitude identifies the entropy or information H 
stored in a system and its disequilibrium D, i.e. the distance from its actual state to 
the probability distribution of equilibrium, as the two basic ingredients for calcu- 
lating its complexity. Hence, the LMC complexity C is given by the formula dl.3l ). 
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C(p) = H(p) ■ D(p), where p = {/?,}, with > and i = 1, - ■ ■ ,N, represents the 
distribution of the N accessible states to the system, and A: is a constant taken as 
1/logN. 

As well as the Euclidean distance D is present in the original LMC complexity, 
other kinds of disequilibrium measures have been proposed in order to remedy some 
statistical characteristics considered troublesome for some authors 1201 . In particu- 
lar, some attention has been focused |21 22| on the Jensen-Shannon divergence Djs 
as a measure for evaluating the distance between two different distributions (p\,p2). 
This distance reads: 



with K\ , 7Z2 the weights of the two probability distributions (pi , p%) verifying n\ , 7T2 > 
and %\ + Tto = 1 . The ensuing statistical complexity 



becomes intensive and also keeps the property of distinguishing among distinct de- 
grees of periodicity l23l . In this section, we consider p2 the equiprobability distri- 
bution and K\=K2 = 0.5. 

As it can be straightforwardly seen, all these LMC-like complexities vanish both 
for completely ordered and for completely random systems as it is required for the 
correct asymptotic properties of a such well-behaved measure. Recently, they have 
been successfully used to discern situations regarded as complex in discrete systems 
out of equilibrium fT8ll24ll25ll26ll27ll28ll29ll30l. 

Here, the local transition to chaos via intermittency 0311 in the logistic map, 
x n +\ = Xx n {\ —x n ) presents a sharp transition when C is plotted versus the param- 
eter X in the region around the instability for A ~ X t = 3.8284. When X < X t the 
system approaches the laminar regime and the bursts become more unpredictable. 
The complexity increases. When the point X = Xt is reached a drop to zero occurs 
for the magnitude C. The system is now periodic and it has lost its complexity. The 
dynamical behavior of the system is finally well reflected in the magnitude C as it 
has been studied in Q). 

When a one-dimensional array of such maps is put together a more complex 
behavior can be obtained depending on the coupling among the units. Ergo the phe- 
nomenon called spatio-temporal intermittency can emerge 11321 [33l [341 . This dy- 
namical regime corresponds with a situation where each unit is weakly oscillating 
around a laminar state that is aperiodically and strongly perturbed for a traveling 
burst. In this case, the plot of the one-dimensional lattice evolving in time gives rise 
to complex patterns on the plane. If the coupling among units is modified the sys- 
tem can settle down in an absorbing phase where its dynamics is trivial I35ll36ll and 
then homogeneous patterns are obtained. Therefore an abrupt transition to spatio- 
temporal intermittency can be depicted by the system l37l [38l when modifying the 
coupling parameter. 

Now we are concerned with measuring C and Cj$ in a such transition for a cou- 
pled map lattice of logistic type. Our system will be a line of sites, i = 1 , . . . , L, with 



Djs{puP2) = H(mp i + K2P2) - n\H(pi) - 7t 2 H(p 2 ) , 



(1.6) 



Cjs — H ■ D JS 



(1.7) 



1.1 A Statistical Measure of Complexity. Some Applications 



13 



periodic boundary conditions. In each site i a local variable x" evolves in time («) 
according to a discrete logistic equation. The interaction with the nearest neighbors 
takes place via a multiplicative coupling: 



= (4-3/>XfK(l-^), 



(1.8) 



where p is the parameter of the system measuring the strength of the coupling (0 < 
p < 1). The variable X" is the digitalized local mean field, 



X" = nint 



( x "i+\ + ■*?-!; 



(1-9) 



with nint(.) the integer function rounding its argument to the nearest integer. Hence 
X" =0or 1. 



2.5 




Fig. 1.4 j8 versus p. The j8 -statistics (or BW density) for each p is the rate between the number 
of black and white cells depicted by the system in the two-dimensional representation of its after- 
transient time evolution. (Computations have been performed with Ap — 0.005 for a lattice of 
10000 sites after a transient of 5000 iterations and a running of other 2000 iterations). 



There is a biological motivation behind this kind of systems ||39l l40l . It could 
represent a colony of interacting competitive individuals. They evolve randomly 
when they are independent (p = 0). If some competitive interaction (p > 0) among 
them takes place the local dynamics loses its erratic component and becomes chaotic 
or periodic in time depending on how populated the vicinity is. Hence, for bigger 
X" more populated is the neighborhood of the individual i and more constrained is 
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its free action. At a first sight, it would seem that some particular values of p could 
stabilize the system. In fact, this is the case. Let us choose a number of individuals 
for the colony (L = 500 for instance), let us initialize it randomly in the range < 
Xi < 1 and let it evolve until the asymptotic regime is attained. Then the black/white 
statistics of the system is performed. That is, the state of the variable xi is compared 
with the critical level 0.5 for i = 1,...,L: if x< > 0.5 the site i is considered white 
(high density cell) and a counter N w is increased by one, or if x, < 0.5 the site i 
is considered black (low density cell) and a counter Nj, is increased by one. This 
process is executed in the stationary regime for a set of iterations. The black/white 
statistics is then the rate j3 = N/,/N w . If j5 is plotted versus the coupling parameter p 
the Figure [T~4l is obtained. 



p=0.200 p=0.256 




Fig. 1.5 Digitalized plot of the one-dimensional coupled map lattice (axe OX) evolving in time 
(axe OY) according to Eq. dl.8t : if > 0.5 the (i,n)-cell is put in white color and if x" < 0.5 the 
(;,n)-cell is put in black color. The discrete time n is reset to zero after the transitory. (Lattices of 
300 x 300 sites, i.e., < i < 300 and < n < 300). 

The region 0.258 < p < 0.335 where /3 vanishes is remarkable. As stated above, 
j3 represents the rate between the number of black cells and the number of white 
cells appearing in the two-dimensional digitalized representation of the colony evo- 
lution. A whole white pattern is obtained for this range of p. The phenomenon of 
spatio-temporal intermittency is displayed by the system in the two borders of this 
parameter region (Fig. II. 51 ). Bursts of low density (black color) travel in an irregular 
way through the high density regions (white color). In this case two-dimensional 
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complex patterns are shown by the time evolution of the system (Fig. |1.5b -c). If the 
coupling p is far enough from this region, i.e., p < 0.25 or p > 0.4, the absorbent 
region loses its influence on the global dynamics and less structured and more ran- 
dom patterns than before are obtained (Fig. ll.5b -d). For p = we have no coupling 
of the maps, and each map generates so called fully developed chaos, where the in- 
variant measure is well-known to be symmetric around 0.5. From this we conclude 
that j3 (p = 0) = 1 . Let us observe that this symmetrical behavior of the invariant 
measure is broken for small p, and j3 decreases slightly in the vicinity of p = 0. 

If the LMC complexities are quantified as function of p, our intuition is con- 
firmed. The method proposed in Ref. @ to calculate C is now adapted to the case 
of two-dimensional patterns. First, we let the system evolve until the asymptotic 
regime is attained. This transient is discarded. Then, for each time n, we map the 
whole lattice in a binary sequence: if x" < 0.5 and 1 if jc" > 0.5, for i = 1 , . . . ,L. 
This L-binary string is analyzed by blocks of n bits, where n a can be considered 
the scale of observation. For this scale, there are 2"° possible states but only some of 
them are accessible. These accessible states as well as their probabilities are found 
in the L-binary string. Next, the magnitudes H, D, Djs, C and Cjs are directly calcu- 
lated for this particular time n by applying the formulas ( 11.31 ,( 11.71 ). We repeat this 
process for a set of successive time units (n,n + 1, • • • ,« + m). The mean values of 
H, D, Djs, C and Cjs for these m time units are finally obtained and plotted in Figs. 

OTP 
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Figures [1 .611 .71 show the result for the case of n = 10. Let us observe that the 
highest C and Cjs are reached when the dynamics displays spatio-temporal intermit- 
tency, that is, the most complex patterns are obtained for those values of p that are 
located on the borders of the absorbent region 0.258 < p < 0.335. Thus the plot of 
C and Cjs versus p shows two tight peaks around the values p = 0.256 and p = 0.34 
(Figs. [Oil. 7b . Let us remark that the LMC complexity C can be neglected far from 
the absorbent region. Contrarily to this behavior, the magnitude Cjs also shows high 
peaks in some other sharp transition of j3 located in the region < p < 25, and an 
intriguing correlation with the black/white statistics in the region 0.4 < p < 1. All 
these facts as well as the stability study of the different dynamical regions of system 
( 11.81 ) are not the object of the present writing but they could deserve some attention 
in a further inspection. 

If the detection of complexity in the two-dimensional case requires to identify 
some sharp change when comparing different patterns, those regions in the param- 
eter space where an abrupt transition happens should be explored in order to obtain 
the most complex patterns. Smoothness seems not to be at the origin of complexity. 
As well as a selected few distinct molecules among all the possible are in the basis 
of life fiTll . discreteness and its spiky appearance could indicate the way towards 
complexity. As we show in the next section, the distributions with the highest LMC 
complexity are just those distributions with a spiky-like appearance fT8l . In this line, 
the striking result here exposed confirms the capability of the LMC-like complexi- 
ties for signaling a transition to complex behavior when regarding two-dimensional 
patterns 17711421 . 



1.1.2 Complexity versus time: the tetrahedral gas 

As before explained, several definitions of complexity, in the general sense of the 
term, have been presented in the literature. These can be classified according to 
their calculation procedure into two broad and loosely defined groups. One of these 
groups is based on computational science and consists of all definitions based on 
algorithms or automata to derive the complexity. Examples are the algorithmic com- 
plexity |9|, the logical depth ifTTl and the e-machine complexity lfl5ll . These defini- 
tions have been shown to be very useful in describing symbolic dynamics of chaotic 
maps, but they have the disadvantage of being very difficult to calculate. Another 
broad group consists of those complexities based on the measure of entropy or en- 
tropy rate. Among these, we may cite the effective measure complexity Ifl2ll . the 
thermodynamic depth fl4l . the simple measure for complexity 0251 and the metric 
or K-S entropy rate [43 44]. These definitions have also been very useful in describ- 
ing symbolic dynamics in maps, the simple measure of complexity having been also 
applied to some physical situation such as a non-equilibrium Fermi gas 14511 . They 
suffer the disadvantage of either being very difficult to calculate or having a simple 
relation to the regular entropy. 
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Fig. 1.7 (•) Cjs versus p. The peaks of this modified LMC complexity are also evident just on the 
borders of the absorbent region 0.258 < p < 0.335, where /3 = (x). (Computations have been 
performed with Ap = 0.005 for a lattice of 10000 sites after a transient of 5000 iterations and a 
running of other 2000 iterations). 

Other definition types of complexity have been introduced. These are based on 
quantities that can be calculated directly from the distribution function describing 
the system. One of these is based on "meta-statistics" (46| and the other on the no- 
tion of "disequilibrium" |7|. This latter definition has been referred above as the 
LMC complexity. These definitions, together with the simple measure for complex- 
ity l25l . have the great advantage of allowing easy calculations within the context 
of kinetic theory and of permitting their evaluation in a natural way in terms of 
statistical mechanics. 

As we have shown in the former sections, the disequilibrium-based complex- 
ity is easy to calculate and shows some interesting properties (7), but suffers from 
the main drawback of not being very well behaved as the system size increases, or 
equivalently, as the distribution function becomes continuous. Feldman and Crutch- 
field 1201 tried to solve this problem by defining another equivalent term for dise- 
quilibrium, but ended up with a complexity that was a trivial function of the entropy. 

Whether these definitions of complexity are useful in non-equilibrium thermo- 
dynamics will depend on how they behave as a function of time. There is a general 
belief that, although the second law of thermodynamics requires average entropy 
(or disorder) to increase, this does not in any way forbid local order from arising 
B7l . The clearest example is seen with life, which can continue to exist and grow 
in an isolated system for as long as internal resources last. In other words, in an 
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isolated system the entropy must increase, but it should be possible, under certain 
circumstances, for the complexity to increase. 

Here we examine how LMC complexity evolves with time in an isolated system 
and we show that it indeed has some interesting properties. The disequilibrium- 
based complexity Q defined in equation ( 11.31 ) actually tends to be maximal as the 
entropy increases in a Boltzmann integro-differential equation for a simplified gas. 

We proceed to calculate the distributions which maximize and minimize the com- 
plexity and its asymptotic behavior, and also introduce the basic concepts underlying 
the time evolution of LMC complexity in Sect. 11.1.2.11 Later, in Sects. [P .2.21 and 
11.1.2.31 by means of numerical computations following a restricted version of the 
Boltzmann equation, we apply this to a special system, which we shall term "tetra- 
hedral gas". Finally, in Sect. 11. 1.2.41 the results and conclusions for this system are 
given, together with their possible applications. 

1.1.2.1 Maximum and minimum complexity 

In this section, we assume that the system can be in one of its N possible accessible 
states, ;. The probability of the system being in state i will be given by the discrete 
distribution function, f\ > 0, with the normalization condition / = £j=i fi = L The 
system is defined such that, if isolated, it will reach equilibrium, with all the states 
having equal probability, f e = ^. Since we are supposing that H is normalized, < 
H < 1, and 0<D<(N—l)/N, then complexity, C, is also normalized, < C < 1. 

When an isolated system evolves with time, the complexity cannot have any pos- 
sible value in a C versus H map as it can be seen in Fig. II. 21 ). but it must stay within 
certain bounds, C max and C m ; n . These are the maximum and minimum values of C 
for a given H. Since C = DH, finding the extrema of C for constant H is equivalent 
to finding the extrema of D. 

There are two restrictions on D: the normalization, /, and the fixed value of the 
entropy, H. To find these extrema undetermined Lagrange multipliers are used. Dif- 
ferentiating expressions of D, I and H, we obtain 



dD 



2(/)-/e), 



(1.10) 



dfj 



dl 



1 



(l.H) 



dfj 



dH 



— (ln/, + 1) . 



(1.12) 



dfj 



Defining X\ and %i as the Lagrange multipliers, we get: 



2(fj - / e ) + l x + A 2 (ln/ 7 - + l)/lniV = . 



(1.13) 



Two new parameters, a and j5, which are a linear combinations of the Lagrange 
multipliers are defined: 
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fj + a\nfj + p = 0, (1.14) 

where the solutions of this equation, fj, are the values that minimize or maximize 
the disequilibrium. 

In the maximum complexity case there are two solutions, /,-, to Eq. ( 11.14b which 
are shown in Table ll.ll One of these solutions, / max , is given by 



1 

H = 

In A? 



/max In /max + ( 1 — /max) In 



1 /ma; 

N-l 



(1.15) 



and the other solution by ( 1 — / max )/(N— 1 ) . 

The maximum disequilibrium, Z) max , for a fixed H is 

Omax = (/max ~ fe? + (N - 1) ( - frj , (1.16) 

and thus, the maximum complexity, which depends only on H, is 

C m ax(H)=D max -//. (1.17) 

The behavior of the maximum value of complexity versus InN was computed in 
Ref. RID. 



Table 1.1 Probability values, fj, that give a maximum of disequilibrium, D max . for a given H. 



Number of states 
with fj 


fj 


Range of f j 


1 


fmax 




N— 1 


1 /max 
N-\ 


0...1 



Table 1.2 Probability values, f j, that give a minimum of disequilibrium, £>,„;„, for a given H. 



Number of states 


fj 


Range of /, 


with f j 


n 








1 


/min 




N-n- 1 


1 ~ ./min 


1 1 


N-n- 1 


N-n ••• W-n-1 



n can have the values 0,1, . . . N — 2. 



Equivalently, the values, fj, that give a minimum complexity are shown in Table 
PI One of the solutions, / m i n , is given by 



H = - 



1 

ln>Y 



/min In /min + (1 - /min) In 



1 /min 

iV-n- 1 



(1.18) 
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where n is the number of states with f> = and takes a value in the range n 
0,1, ... ,N-2. 



N 




Fig. 1.8 Maximum, minimum, and minimum envelope complexity, C max » C m ; n , and C m ; n env respec- 
tively, as a function of the entropy, H, for a system with N = 4 accessible states. 



The resulting minimum disequilibrium, D m ; n , for a given H is, 



A™n = (/min-/e) 2 + (jV-n-l) 



1 ,/min 

N-n-l 



/e + "/e 



(1.19) 



Note that in this case fj = is an additional hidden solution that stems from the 
positive restriction in the /, values. To obtain these solutions explicitly we can define 
xt such that f = x, 2 . These xi values do not have the restriction of positivity imposed 
to fi and can take a positive or negative value. If we repeat the Lagrange multiplier 
method with these new variables a new solution arises: xs = 0, or equivalently, fj = 
0. 

The resulting minimum complexity, which again only depends on H, is 

C rain (//)=Anin-H. (1.20) 

As an example, the maximum and minimum of complexity, C max and C m j n , are plot- 
ted as a function of the entropy, H, in Fig. ll.8l for N = A. Also, in this figure, it is 
shown the minimum envelope complexity, C m i nen v = ^minenv ■ H, where Aninenv is 
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defined below. In Fig. 11.91 the maximum and minimum disequilibrium, Z) max and 
D min. versus H are also shown. 




As shown in Fig. |1.9| the minimum disequilibrium function is piecewise defined, 
having several points where its derivative is discontinuous. Each of these function 
pieces corresponds to a different value of n (Table II. 21 ). In some circumstances it 
might be helpful to work with the "envelope" of the minimum disequilibrium func- 
tion. The function, D m i nenv , that traverses all the discontinuous derivative points in 
the D m i n versus H plot is 

r> — —H\nN _ / 1 

^minenv — " ^ i K^-^-^f 

and is also shown in Figure [L9l 

When N tends toward infinity the probability, f max , of the dominant state has a 
linear dependence with the entropy, 

lim/ max = l-H, (1.22) 

and thus the maximum disequilibrium scales as lim;v^oo £> m ax = ( 1 — H) 2 . The max- 
imum complexity tends to 
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limC max =//(l-//) 2 . (1.23) 

The limit of the minimum disequilibrium and complexity vanishes, lim^^oo £> m inenv = 
0, and thus 

limC min = 0. (1.24) 

In general, in the limit N —> °°, the complexity is not a trivial function of the entropy, 
in the sense that for a given H there exists a range of complexities between and 
Cmax, gi yen by Eqs. d 1 . 24t and dl.23t , respectively. 

In particular, in this asymptotic limit, the maximum of C max is found when 
H = 1/3, or equivalently / max = 2/3, which gives a maximum of the maximum 
complexity of C max =4/27. This value was numerically calculated in Ref. l48l . 



1.1.2.2 An out equilibrium system: the tetrahedral gas 

We present a simplified example of an ideal gas: the tetrahedral gas. This system is 
generated by a simplification of the Boltzmann integro-differential equation of an 
ideal gas. We are interested in studying the disequilibrium time evolution. 



1 




Fig. 1.10 The four possible directions of the velocities of the tetrahedral gas in space. Positive 
senses are defined as emerging from the center point and with integer numbers 1,2,3,4. 

The Boltzmann integro-differential equation of an ideal gas with no external 
forces and no spatial gradients is 

J d 3 ^J ^ c . m .a(v,-v^v:-v')|v,-v| [f(v>,;t)f(v>;t)-f(v*;t)f(v,t)} , 

(1.25) 
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where a represents the cross section of a collision between two particles with initial 
velocities v and v* and after the collision with velocities v' and v^; and £2 c . m . are all 
the possible dispersion angles of the collision as seen from its center of mass. 

In the tetrahedral gas, the particles can travel only in four directions in three- 
dimensional space and all have the same absolute velocity. These directions are the 
ones given by joining the center of a tetrahedron with its corners. The directions 
can be easily viewed by recalling the directions given by a methane molecule, or 
equivalently, by a caltrop, which is a device with four metal points so arranged that 
when any three are on the ground the fourth projects upward as a hazard to the 
hooves of horses or to pneumatic tires (see Fig. ll.10t . 

By definition, the angle that one direction forms with any other is the same. It 
can be shown that the angles between different directions, a, satisfy the relationship 
cos a = —1/3, which gives a = 109.47°. The plane formed by any two directions 
is perpendicular to the plane formed by the remaining two directions. 

We assume that the cross-section, a, is different from zero only when the angle 
between the velocities of the colliding particles is 109.47°. It is also assumed that 
this collision makes the two particles leave in the remaining two directions, thus 
again forming an angle of 109.47°. A consequence of these restrictions is that the 
modulus of the velocity is always the same no matter how many collisions a parti- 
cle has undergone and they always stay within the directions of the vertices of the 
tetrahedron. Furthermore, this type of gas does not break any law of physics and is 
perfectly valid, although hypothetical. 

We label the four directions originating from the center of the caltrop with num- 
bers, 1,2,3,4 (see Fig. 1 1 . 10b . The velocity components with the same direction but 
opposite sense, or equivalently, directed toward the center of the caltrop, are labeled 
with negative numbers —1, —2, —3, —4. 

In order to formulate the Boltzmann equation for the tetrahedral gas, and because 
all directions are equivalent, we need only study the different collisions that a par- 
ticle with one fixed direction can undergo. In particular if we take a particle with 
direction — 1 the result of the collision with another particle with direction —2 are 
the same two particles traveling in directions 3 and 4, that is, 

(-1,-2) -> (3,4). (1.26) 

With this in mind the last bracket of Eq. (11.25b is, 

hU-f-if-2, (1-27) 

where denotes the probability of finding a particle in direction i. Note that the 
dependence on velocity, v, of the continuous velocity distribution function, /(v;f), 
of Eq. ( I1.25l l is in our case contained in the discrete subindex, i, of the distribution 
function 

We can proceed in the same manner with the other remaining collisions, 



(-1,-3) -> (2,4), 
(-1,-4) ^(2,3). 



(1.28) 
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When a particle with direction —1 collides with a particle with direction 2, they do 
not form an angle of 109.47°; i.e., they do not collide, they just pass by each other. 
This is a consequence of the previous assumption for the tetrahedral gas, which 
establishes a null cross section for angles different from 109.47°. The same can be 
said for collisions (—1,3), (—1,4), and (—1,1). All these results are summarized in 
Table 

Table 1.3 Cross sections, o", for a particle in direction —1 colliding with particles in the other 
remaining directions of the tetrahedral gas. 



Collision 


Cross section 


of particles 


a 


(-1,-2) (3,4) 


1 


(-1,-3) -> (2,4) 


1 


(-1,-4) (2,3) 


1 


Other collisions 






Taking all this into account, Eq. ( 11.25b for direction —1 is reduced to a discrete 
sum, 

^ = (/3/4-/-1/-2) + (/2/4-/-1/-3) + C/a/3 -/-1/-4) , (1.29) 

where all other factors have been set to unity for simplicity. 

The seven remaining equations for the rest of directions can be easily inferred. If 
we now make /, = /_,■(/ = 1,2,3,4) initially, this property is conserved in time. The 
final four equations defining the evolution of the system are: 

C/3/4 - /1/2) + (Ma - /1/3 ) + Cfzfc - /1/4) , 

(/3/4 - /l/2) + (/l/4 - Mi) + (/l/3 - /2/4) , 

(Ma - /3/1 ) + (/i/4 - Mi) + (Mi - Ma) , 

(/ 2 / 3 -/4/1) + (M3-M1) + (Mi- Ma) ■ (1.30) 

Note that the ideal gas has been reduced to the tetrahedral gas, which is a four- 
dimensional dynamical system. The velocity distribution function, fi, corresponds 
to a probability distribution function with N = 4 accessible states that evolve in time. 

1.1.2.3 Evolution of the tetrahedral gas with time 

To study the time evolution of the complexity, a diagram of C versus time, t , can be 
used. But, as we know, the second law of thermodynamics states that the entropy 



d_h 

dt 
dh 

dt 
dh 

dt 
d_U 

dt 
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grows monotonically with time, that is, 

f>0. (1.31) 
at 

This implies that an equivalent way to study the time evolution of the complexity 
can be obtained by plotting C versus H. In this way, the entropy substitutes the time 
axis, since the former increases monotonically with the latter. The conversion from 
C vs. H to C vs. t diagrams is achieved by stretching or shrinking the entropy axis 
according to its time evolution. This method is a key point in all this discussion. 
Note that, in any case, the relationship of H versus t will, in general, not be a simple 
one ||49l . 

The tetrahedral gas, Eqs. ( 11.301 1, reaches equilibrium when fi = \ /N for i = 
1,2,3,4 and N = 4. This stationary state, dfi/dt = 0, represents the equiprobability 
towards which the system evolves in time. This is consistent with the definition of 
disequilibrium in which we assumed that equilibrium was reached at equiprobabil- 
ity, fi= f e , where D = 0. 



(f 1 ,f 2 ,f 3 ,f 4 )(t=0)=(0.8,0.2,0.0,0.0) (f 1 ,f 2 ,f 3 ,f 4 )(t=0)=(0.5,0.5,0.0,0.0) 




Fig. 1.11 Time evolution of the system in (H.D) phase space for two different initial conditions 
at time t = 0: (a) (JuhJsJi) = (0.8,0.2,0,0) and (b) C/1,/2,/3,/4) = (0.5,0.5,0,0). The maxi- 
mum and minimum disequilibrium are shown by dashed lines. 



As the isolated system evolves it gets closer and closer to equilibrium. In this 
sense, one may intuitively think that the disequilibrium will decrease with time. In 
fact, it can be analytically shown lTT8ll that, as the system approaches to equilibrium, 
D tends to zero monotonically with time: 

dD 

— <0. (1.32) 
at 



There are even more restrictions on the evolution of this system. It would be ex- 
pected that the system approaches equilibrium, D = 0, by following the most direct 
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path. To verify this, numerical simulations for several initial conditions have been 
undertaken. In all of these we observe the additional restriction that D approaches 
D max on its way to D = 0. In fact it appears as an exponential decay of D towards 
D max in a D versus H plot. As an example, two of these are shown in Fig. 11.111 
where Fig. ll.lll" a) shows a really strong tendency towards D max . Contrary to intu- 
ition, among all the possible paths that the system can follow toward equilibrium, it 
chooses those closest to D max in particular. 



(f 1 ,f 2 ,f 3 ,f 4 )(t=0)=(0.8,0.2,0.0,0.0) (f,,f 8 ,f3,f 4 )(t=0)=(0.5,0.5,0.0,0.0) 




Fig. 1.12 Time evolution of the system in (H,C) phase space for two different initial conditions 
attimef = 0: (a) (fufa&fi) = (0.8,0.2,0,0) and (b) (f u faft,fy) = (0.5,0.5,0,0). The maxi- 
mum and minimum complexity are shown by dashed lines. 

We can also observe this effect in a complexity, C, versus H plot. This is shown 
for the same two initial conditions in Figure [TTT21 

This additional restriction to the evolution of the system is better viewed by plot- 
ting the difference C max — C versus H. In all the cases analyzed (see two of them in 
Fig. ll . 13t the following condition is observed: 

d(C max -C) ^ Q ( 
dt 

This has been verified numerically and is illustrated in Figure [TT4l where this time 
derivative, which always remains negative, is shown as a function of H for a grid of 
uniformly spaced distribution functions, (f\ ,/2,/3,/4), satisfying the normalization 
condition /. Two system trajectories are also shown for illustrative purposes. The 
numerical method used to plot this function is explained in ||T8l . 

We proceed now to show another interesting property of this system. As shown 
in Table 1 1 . ll a collection of maximum complexity distributions for N = 4 can take 
the form 

f\ = /max ? 
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(f 1 ,f 2 ,f 3 ,f 4 )(t=0)=(0.8,0.2,0.0,0.0) 



(f 1 ,f 2 ,f 3 ,f 4 )(t=0)=(0.5,0.5,0.0,0.0) 
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Fig. 1.13 Time evolution of the system in (H, C ma x — C) phase space for two different initial con- 
ditions at time f = 0: (a) C/1,/2,/3,/4) = (0.8,0.2,0,0) and (b) {fufi,fo,U) = (0.5,0.5,0,0). The 
values C ra ax — C m in are shown by dashed lines. 



„ 1 /max . ~ „ . 
fi = 5 ,2 = 2,3,4, 



(1.34) 



where / max runs from l/N (equiprobability distribution) to 1 ("crystal" distribution). 
The complexity of this collection of distributions covers all possible values of C max . 

There is actually a time evolution of the tetrahedral gas, or trajectory of the sys- 
tem, formed by this collection of distributions. Inserting Eqs. ( 11.34b in the evolution 
Eqs. (11.301 , it is found that all equations are compatible with each other and the 
dynamical equations are reduced to the relation, 



dfn- 



dt 



-(4/, 
3 V Jt 



max 



-5/ max + l). 



(1.35) 



This trajectory is denoted as the maximum complexity path. 

Note that the equiprobability or equilibrium, / raax = 1 /4, is a stable fixed point 
and the maximum disequilibrium "crystal" distribution, / max = 1, is an unstable 
fixed point. Thus the maximum complexity path is a heteroclinic connection be- 
tween the "crystal" and equiprobability distributions. 

The maximum complexity path is locally attractive. Let us assume, for instance, 
the following perturbed trajectory 

,f\ = /max , 

1 /max 



h 
h 
h 



3 

1 /max 

3 

1 /max 



-5, 



(1.36) 
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Fig. 1.14 Numerical verification of d(C mm — C) /dt < 0. This time derivative is shown as a function 
of H. A grid of uniformly spaced, Afi = 0.5, distribution functions, (fl,f2,f3,fl), satisfying the 
normalization condition /, have been used. Two system trajectories for initial conditions, t = 0, 
(/i,/2,/3,/4) = (0.8,0.2,0,0) and (/i,/ 2 ,/ 3 ,/ 4 ) = (0.5,0.5,0,0) are also shown for illustrative 
purposes. It can be seen how the above-mentioned time derivative always remains negative. 



whose evolution according to Eqs. ( 11.30b gives the exponential decay of the pertur- 
bation, 8: 

dt 



8. 



(1.37) 



showing the attractive nature of these trajectories. 



1.1.2.4 Conclusions and further remarks 



In the former section, the time evolution of the LMC complexity, C, has been studied 
for a simplified model of an isolated ideal gas: the tetrahedral gas. In general, the 
dynamical behavior of this quantity is bounded between two extremum curves, C max 
and C m i n , when observed in a C versus H phase space. These complexity bounds 
have been derived and computed. A continuation of this work applied to the study 
of complexity in gases out of equilibrium can be found in Refs. l50ll5T1 . 

For the isolated tetrahedral gas two constraints on its dynamics are found. The 
first, which is analytically demonstrated, is that the disequilibrium, D, decreases 
monotonically with time until it reaches the value D = for the equilibrium state. 
The second is that the maximum complexity paths, C max , are attractive in phase 
space. In other words, the complexity of the system tends to equilibrium always ap- 
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Maximum complexity path 




0.2 0.4 0.6 0.8 

H 



Fig. 1.15 The time evolution of the system for three different initial conditions, t = 0, 
(/i./2,/3,/4) = (0.8,0.2,0,0), (/i,/2,/3,/4) = (0.5, 0.5, 0,0), and the maximum complexity path 
are shown. The minimum complexity is shown by dashed lines. It can be seen how the system 
tends to approach the maximum complexity path as it evolves in time toward equilibrium. 

proaching those paths. This has been verified numerically, that is, the time derivative 
of the difference between C max and C is negative. Fi g . 1 1 . 1 5 1 summarizes the dynam- 
ical behavior of the tetrahedral gas. The different trajectories starting with arbitrary 
initial conditions, which represent systems out of equilibrium, evolve towards equi- 
librium approaching the maximum complexity path. 

Whether these properties are useful in real physical systems can need of a fur- 
ther inspection, particularly the macroscopical nature of the disequilibrium in more 
general systems, such as to the ideal gas following the complete Boltzmann integro- 
differential equation. Another feature that could deserve attention is the possibility 
of approximating the evolution of a real physical system trajectory to its maximum 
complexity path. Note that in general, for a real system, the calculation of the max- 
imum complexity path will not be an easy task. 



1.2 The Statistical Complexity in the Continuous Case 

As explained in the former sections, the LMC statistical measure of complexity Q 
identifies the entropy or information stored in a system and its distance to the equi- 
librium probability distribution, the disequilibrium, as the two ingredients giving the 
correct asymptotic properties of a well-behaved measure of complexity. In fact, it 
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vanishes both for completely ordered and for completely random systems. Besides 
giving the main features of an intuitive notion of complexity, it has been shown that 
LMC complexity successfully enables us to discern situations regarded as complex 
in discrete systems out of equilibrium: one instance of phase transitions via inter- 
mittency in coupled logistic maps ifTTl or via stochastic synchronization in cellular 
automata ll42l . the dynamical behavior of this quantity in a out-equilibrium gases 
lfT8ll50ll5Tl and other applications in classical statistical mechanics ll30ll52l . 

A possible formula of LMC complexity for continuous systems was suggested 
in formula ( 11.4b . Anteneodo and Plastino l48l pointed out some peculiarities con- 
cerning such an extension for continuous probability distributions. It is the aim of 
this section to offer a discussion of the extension of LMC complexity for contin- 
uous systems and to present a slightly modified extension |53ll of expression dl.4| > 
that displays interesting and very striking properties. A further generalization of this 
work has been done in Ref . Il54l l55l . 

In Sect. 11.2. li the extension of information and disequilibrium concepts for the 
continuous case are discussed. In Sect. 11.2.21 the LMC measure of complexity is 
rewieved and possible extensions for continuous systems are suggested. We proceed 
to present some properties of one of these extensions in Sect. 11.2.31 



1.2.1 Entropy/information and disequilibrium 

Depending on the necessary conditions to fulfill, the extension of an established 
formula from the discrete to the continuous case always requires a careful study and 
in many situations some kind of choice between several possibilities. Next we carry 
out this process for the entropy and disequilibrium formulas. 

1.2.1.1 Entropy or information 

As we know, given a discrete probability distribution {/?,},=i.2 n satisfying pi > 



and Yfi=\Pi = 1> tne Boltzmann-Gibss-Shannon formula [4| that accounts for the 
entropy or information, S, stored in a system is defined by 



where k is a positive constant. If we identify H with S, then some properties of 
this quantity are: (i) positivity: H > for any arbitrary set {/?,}, (ii) concavity: H 
is concave for arbitrary {pj} and reaches the extremal value for equiprobability 
(Pi = 1 /N V;'), (iii) additivity: H(A U B) = H(A) + H(B) where A and B are two 
independent systems, and (iv) continuity: H is continuous for each of its arguments. 
And vice versa, it has been shown that the only function of {/?,} verifying the latter 
properties is given by Eq. (11.38b J4][56). For an isolated system, the irreversibility 



N 



S[{pi}) = -k^ t pilog Pi 



(1.38) 



<■=] 
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property is also verified, that is, the time derivative of H is positive, dH/dt > 0, 
reaching the equality only for equilibrium. 

Calculation of H for a continuous probability distribution p(x), with support on 
[— L,L] and J^ L p(x)dx = 1, can be performed by dividing the interval [— L,L] in 
small equal-length pieces Ax = Xj — jc,-_i, i = 1, ■ • • ,n, with xq — —L and x„ = L, 
and by considering the approximated discrete distribution {/?,} = {p(xi)Ax}, i = 
1 , • • • , n, with xi a point in the segment [x,_ i , x,] . It gives us 

H*=H({ Pi })= (1.39) 

n n 

= -kY,p{xi)logp(xi)Ax - k' s £ J p{xi)\og(Ax)Ax. 

i=i i=i 

The second adding term of H* in the expression (|1.39t grows as log n when n goes 
to infinity. Therefore it seems reasonable to take just the first and finite adding term 
of H* as the extension of H to the continuous case: H(p(x)). It characterizes with 
a finite number the information contained in a continuous distribution p(x). In the 
limit n — > °°, we obtain 

n 



-kJ^p(xj)logp(xi)Aj 

i=i 

L 



H{p{xj) = lim 

11— >oa 

= -k J L p(x)logp(x)dx. (1.40) 



If p(x) > 1 in some region, the entropy defined by Eq. ( 1 1 .401 ) can become negative. 
Although this situation is mathematically possible and coherent, it is unfounded 
from a physical point of view. See ||57l for a discussion on this point. Let f(p,q) 
be a probability distribution in phase space with coordinates (p,q), /> and dpdq 
having the dimension of an action. In this case the volume element is dpdq/h with 
h the Planck constant. Suppose that H(f) < 0. Because of J (dpdq/h) f = 1, the 
extent of the region where / > 1 must be smaller than h. Hence a negative classical 
entropy arises if one tries to localize a particle in phase space in a region smaller than 
h, that is, if the uncertainty relation is violated. In consequence, not every classical 
probability distribution can be observed in nature. The condition H(f) = could 
give us the mininal width that is physically allowed for the distribution and so the 
maximal localization of the system under study. This cutting property has been used 
in the calculations performed in 



1.2.1.2 Disequilibrium 

Given a discrete probability distribution {p,} i= i.2 n satisfying pi > and Yd=i Pi = 

1, its Disequilibrium, D, can be defined as the quadratic distance of the actual prob- 
ability distribution {/?,-} to equiprobability: 
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N / i \2 
£({/><}) = £ \ Pi - jj) ■ (1.41) 

D is maximal for fully regular systems and vanishes for completely random ones. 

In the continuous case with support on the interval [—L,L], the rectangular func- 
tion p(x) = 1/ (2L), with — L < x < L, is the natural extension of the equiprobability 
distribution of the discrete case. The disequilibrium could be defined as 




(1.42) 



If we redefine D omitting the constant adding term in D*, the disequilibrium reads 
now: 

rL 

D(p(x)) = J p 2 {x)dx. (1.43) 

D > for every distribution and it is minimal for the rectangular function which 
represents the equipartition. D does also tend to infinity when the width of p(x) 
narrows strongly and becomes extremely peaked. 



1.2.2 The continuous version C of the LMC complexity 

As shown in the previous sections, LMC complexity has been successfully calcu- 
lated in different systems out of equilibrium. However, Feldman and Cruchtfield 
11201 presented as a main drawback that C vanishes and it is not an extensive vari- 
able for finite-memory regular Markov chains when the system size increases. This 
is not the general behavior of C in the thermodynamic limit as it has been suggested 
by Calbet and Lopez-Ruiz lfl8l . On the one hand, when N — > °° and k = \/\ogN, 
LMC complexity is not a trivial function of the entropy, in the sense that for a given 
H there exists a range of complexities between and C max {H), where C, mx is given 
by expression dl.23l ). 

Observe that in this case H is normalized, < H < 1, because k = 1/logAf. 
On the other hand, non-extensitivity cannot be considered as an obstacle since it is 
nowadays well known that there exists a variety of physical systems for which the 
classical statistical mechanics seems to be inadequate and for which an alternative 
non-extensive thermodynamics is being hailed as a possible basis of a theoretical 
framework appropriate to deal with them 1581 . 

According to the discussion in Section 11.2.11 the expression of C for the case 
of a continuum number of states, x, with support on the interval [— L,L] and 
J^ L p(x)dx= 1 , is defined by 

C(p(x))=H(p(x))-D(p(x)) = 

-k ( p{x)\ogp(x)dx) ■ ( ( p 2 {x)dx\ . (1.44) 



-L I \J-L 
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Hence, C can become negative. Obviously, C < implies H < 0. Although this sit- 
uation is coherent from a mathematical point of view, it is not physically possible. 
Hence a negative entropy means to localize a system in phase space into a region 
smaller than h (Planck constant) and this would imply to violate the uncertainty 
principle (see discussion of Section [T.2.1.U . Then a distribution can broaden with- 
out any limit but it cannot become extremely peaked. The condition H = could 
indicate the minimal width that p(x) is allowed to have. Similarly to the discrete 
case, C is positive for any situation and vanishes both for an extreme localization 
and for the most widely derealization embodied by the equiprobability distribu- 
tion. Thus, LMC complexity can be straightforwardly calculated for any continuous 
distribution by Eq. ( 11.44b . Anyway, the positivity of C for every distribution in the 
continuous case can be recovered by taking the exponential of S [5911 and redefining 
H according to this exponential, i.e. H = e s . To maintain the same nomenclature 
than in the precedent text we continue to identify H with S and we introduce the 
symbol H = e H . Then the new expression of the statistical measure of complexity 
C is identified as C in the rest of this section and is given by |53"1 

C(p(x))=8(p(x))-D(p(x))=e H (rW .D{p(x)) . (1.45) 

In addition to the positivity, C encloses other interesting properties that we describe 
in the next section. 



1.2.3 Properties of C 

The quantity C given by Eq. ( 11.45b has been presented as one of the possible ex- 
tensions of the LMC complexity for continuous systems 1531 . We proceed now to 
present some of the properties that characterize such a complexity indicator. 

1.2.3.1 Invariance under translations and rescaling transformations 

If p(x) is a density function defined on the real axis R, f R p(x)dx = 1, and a > 
and j3 are two real numbers, we denote by p a p(x) the new probability distribution 
obtained by the action of a j3 -translation and an a-rescaling transformation on p(x), 

Pa,p(x) = ap(a(x-P)) . (1.46) 

When a < 1, p a p (x) broadens whereas if a > 1 it becomes more peaked. Observe 
that p a ,p(x) is also a density function. After making the change of variable y = 
a(x — [}) we obtain 



/ PaB( x )dx= / ap(a(x — f}))dx= / p(y)dy = l. (1.47) 

JR JR JR 
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The behaviour of H under the transformation given by Eq. ( 1 1.461 ) is the following: 



H iPa,p) = - Pa i pi x )^Pa i pi x ) dx = ~ / p(y)^g(ap(y))dy 

J R J R 

= - / p{y)\°EP{y)dy~\oga / p(y)dy 
Jr Jr 

= //(/?) -log a. (1.48) 

Then, 

fi(j> a ,f } )=e H ^ = ^-, (1.49) 
It is straightforward to see that D(p a a) = aD(p), and to conclude that 

C(p a ,p)=H{p a ,p)-D(p a ^) = -^-aD(p)=C{p) . (1.50) 

Observe that translations and rescaling transformations keep also the shape of the 
distributions. Then it could be reasonable to denominate the invariant quantity C as 
the shape complexity of the family formed by a distribution p(x) and its transformed 
Pa,pi x )- Hence, for instance, the rectangular II(x), the isosceles-triangle shaped 
A(x), the gaussian -T(x), or the exponential E(x) distributions continue to belong 
to the same fl, A, F or E family, respectively, after applying the transformations 
defined by Eq. ( I1.461 l. Calculation of C on these distribution families gives us 



C(JT) = 


1 




(1.51) 


C(A) = 




v 1.0991 


(1.52) 


c(r) = 




« 1.1658 


(1.53) 


C(S) = 


e 
2 


a 1.3591 . 


(1.54) 



Remark that the family of rectangular distributions has a smaller C than the rest of 
distributions. This fact is true for every distribution and it will be proved in Section 
11.2.3.41 



1.2.3.2 Invariance under replication 

Lloyd and Pagels ifPfll recommend that a complexity measure should remain essen- 
tially unchanged under replication. We show now that C is replicant invariant, that 
is, the shape complexity of m replicas of a given distribution is equal to the shape 
complexity of the original one. 

Suppose p(x) a compactly supported density function, f'^ 00 p(x)dx = 1. Take n 
copies p m (x), m= ,n, of p(x), 
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p m (x) = -^= p(Vn(x - A,,,)) , 1 < m < n, (1.55) 
V" 

where the supports of all the p m (x), centered at X' m s points, m = 1, •••,«, are all 
disjoint. Observe that p m (x) dx = i what make the union 

n 

q(x) = £ Pm(x) (1-56) 
i=l 

to be also a normalized probability distribution, J x ao q(x)dx = 1. For every p m (x), a 
straightforward calculation shows that 

H{p m ) = -H{p) + -\ogyfr (1.57) 
n n 

D(p m ) = -^ r D{p). (1.58) 

Taking into account that the m replicas are supported on disjoint intervals on R, we 
obtain 

H(q) =H{p)+\ogy/Ji, (1.59) 

D(q) = ±=D{p). (1.60) 
V« 

Then, 

C(q)=C(p), (1.61) 
what completes the proof of the replicant invariance of C. 



1.2.3.3 Near-continuity 



Continuity is a desirable property of an indicator of complexity. For a given scale 
of observation, similar systems should have a similar complexity. In the continuous 
case, similarity between density functions defined on a common support suggests 
that they take close values almost everywhere. More strictly speaking, let 8 be a 
positive real number. It will be said that two density functions f(x) and g(x) defined 
on the interval I £R are 8 -neighboring functions on / if the Lebesgue measure of 
the points x E I verifying | f(x) — g(x) \ > 8 is zero. A real map T defined on density 
functions on / will be called near-continuous if for any e > there exists 8(e) > 
such that if f(x) and g(x) are (5 -neighboring functions on / then | T(f) — T(g) \ < E. 

It can be shown that the information H, the disequilibrium D and the shape com- 
plexity C are near-continuous maps on the space of density functions defined on a 
compact support. We must stress at this point the importance of the compactness 
condition of the support in order to have near-continuity. Take, for instance, the 
density function defined on the interval [— 1 ,L], 
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8S,d x ) = 



1-5 if - 1 < x < 
| if <x<L 



(1.62) 



otherwise , 

with < 8 < 1 and L > 1 . If we calculate H and D for this distribution we obtain 

(1.63) 

(1.64) 



H(g^) = -(l-5)log(l-5)-51og( I 



D(g S ,L) = (l-8Y 



Consider also the rectangular density function 

X[-i,o](x) 



1 if — 1 <jc< 
otherwise . 



(1.65) 



If < 8 < 8 < 1, gg^(x) and X[-i.6\i x ) are 5-neighboring functions. When 5^0, 
we have that lim^ogSxM ~ X[-i,o]( x )- ^ n tr, i s limit process the support is main- 
tained and near-continuity manifests itself as following, 



\imC(g SL ) 

5-5-0 



1. 



(1.66) 



But if we allow the support L to become infinitely large, the compactness condi- 
tion is not verified and, although lim^oo g g i(x) and X\-l,o]{ x ) are 5-neighboring 
distributions, we have that 



lim C(g S r 



(1.67) 



Then near-continuity in the map C is lost due to the non-compactness of the support 
when L —> This example suggests that the shape complexity C is near-continuous 
on compact supports and this property will be rigorously proved elsewhere. 



1.2.3.4 The minimal shape complexity 

If we calculate C on the example given by Eq. ( |1.62t , we can verify that the shape 
complexity can be as large as wanted. Take, for instance, 8 = The measure C 
reads now 

Thus C becomes infinitely large after taking the limits L —> or L — >• °o. Remark 
that even in the case gg L has a finite support, C is not upper bounded. The density 
functions, g/$ = i\ (l->o) an< ^ £(8= 1 ) (£-><*•)' °^ i nr * n i te ly increasing complexity have 
two zones with different probabilities. In the case t-)0 there is a narrow zone 
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where probability rises to infinity and in the case L — s- °° there exists an increasingly 
large zone where probability tends to zero. Both kind of density functions show a 
similar pattern to distributions of maximal LMC complexity in the discrete case, 
where there is an state of dominating probability and the rest of states have the same 
probability. 

The minimal C given by Eq. (11.68b is found when L=\, that is, when g$ L 
becomes the rectangular density function X[-\,\\- ^ n f act > tne vame C = 1 is the 
minimum of possible shape complexities and it is reached only on the rectangular 
distributions. We sketch now some steps that prove this result. 

Suppose 

f=£hXE k (1.69) 

k=\ 

to be a density function consisting of several rectangular pieces E k , k= 1 on 
disjoint intervals. If jj, k is the Lebesgue measure of E k , calculation of C gives 

c(/)=n(v A *)-ft A ^V (L70) 

k=i y \k=i ) 

Lagrange multipliers method is used to find the real vector ,jj.2, ■ ■ ■ , jU„; 
Ai, X2, ■ ■ ■ , Xn) that makes extremal the quantity C(f) under the condition YH= 1 AfcjU* = 
1. This is equivalent to studying the extrema of logC(/). We define the function 
z(X k ,fi k ) = logC(/) + a (X£ =1 X k fi k - 1), then 



z{h,Vk) = L jM*logA* + log £ ii k ll + a £ X k /i k - 1 . (1.71) 

k=l \k=l J \k=l J 

Differentiating this expression and making the result equal to zero we obtain 

= _ rtlog ^_ rt + JhB_ + c ^ = (1.72) 



2 

X k logX k + — " k , 7 +ca, = (1.73) 



— - log A k + — — 

dUk I"=iMyA/ 



Dividing Eq. ( 11.721 ) by pi k and Eq. d 1 .73b by X k we get 

2A* 



zuvjx] 
x k 



E"=i MyA? 



,a-l=logA* (1.74) 
a = log A,. (1.75) 



Solving these two equations for every At we have 
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for all k . 



(1.76) 



Therefore / is a rectangular function taking the same value X for every interval E^, 
that is, / is the rectangular density function 



where L is the Lebesgue measure of the support. 

Then C(f) = 1 is the minimal value for a density function composed of several 
rectangular pieces because, as we know for the example given by Eq. ( 11.68b . C(f) 
is not upper bounded for this kind of distributions. 

Furthermore, for every compactly supported density function g and for every 
£ > 0, it can be shown that near-continuity of C allows to find a t) -neighboring 
density function / of the type given by expression fll.69t verifying | C(f) — C{g) |< 
e. The arbitrariness of the election of e brings us to conclude that C(g) > 1 for every 
probability distribution g. Thus, we can conclude that the minimal value of C is 1 
and it is reached only by the rectangular density functions. 



1.3 Fisher- Shannon Information Product. Some Applications 
1.3.1 Fisher-Shannon information: definition and properties 

The description of electronic properties by means of information measures was in- 
troduced into quantum chemistry by the pioneering works IBTfl IBTl 162 , 63, 64). In- 
particular Shannon entropy l65ll and Fisher information ll66ll have attracted special 
attention in atomic and molecular physics (See e. g. l67l l68l l69l F70l 1711 1721 1731 1741 



[75]|76l[77]|78l[79l[80l[8ll[82][83]^ 89, 90 91 , 92 92113193). It is 



known that these two information measures give complementary descriptions of the 
concentration and uncertainty of the probablility density: S p (I p ) can be seen as a 
global (local) measure of spreading. In this context, the Fisher-Shannon information 
product (that we will define bellow) was found as a link between these information 
measures to improve the characterzation of a probability density function in terms 
of information measures fTSll . 

The single-electron density, the basic variable of the density functional theory 
fl%ll of D-dimensional many-electron systems is given by 



f = X-% L with A 



1 1 



(1-77) 




(1.78) 



where f (ri, ...,!"#) denotes the normalized wavefunction of the N-electron system 
and p (r) is normalized to unity. The spreading of this quantity is best measured by 
the Shannon information entropy 
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S p = - [ p(r)lnp(r)d D r, (1.79) 



or equivalently by the Shannon entropy power 
On the other hand the Fisher information [66 59 1 of p (r) is given by 

12 



Ip= f\ipm dDr 



P(r) 



(1.81) 



The sharpness, concentration or delocalization of the electronic cloud is mea- 
sured by both quantities. It is known that these two information measures give 
complementary descriptions of the smoothness and uncertainty of the electron lo- 
calization: S p and I p are global and local measures of smoothness, respectively 



For completeness let us point out that the aforementioned information measures, 
which refer to an unity-normalized density pi(r) = p(r), are related to the corre- 
sponding measures of the Abnormalized density pjv(r) by 

S PN = -N\nN + NSp and Ip N =NI p (1.82) 

for the Shannon and Fisher quantities, respectively. 

The information product concept P p was originally defined in lf75l as 

Pp = ^J p Ip, (1.83) 

and it was applied in the study of electronic properties of quantum systems during 
last years (See, eg. [75] US |9T] |§2 E31 ISIl Ml USD). Next we will put foward some 
mathematical properties which have been obtained in |[75l [801 11001 1 1 1 1 for the 
Fisher-Shannon information product P p . 



1.3.1.1 Scaling property 

The Fisher information and the Shannon entropy power transform as 

l Py = f-%\ Jp Y = y- [D - x) J P (1.84) 

under scaling of the probability density p(r) by a real scalar factor y; i. e. when 
Py(r) = y D p(7r). This indicates that they are homogeneous density functionals of 
degrees 2 and —2, respectively. Consequently, the information product P p = j^JpIp 
is invariant under this scaling transformation, i. e. 



Pp y - Pp 



(1.85) 
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1.3.1.2 Uncertainty properties 



The Fisher information I p and the Shannon entropy power J p satisfy the uncertainty 
relationship |59l 

~JpIp>l- d-86) 

Remark that when one of the involved quantities decreases near to zero, the other has 
to increase to a large value. Moreover, it is closely linked to the uncertainty relation 



(r 2 }(p 2 ) > where (r 2 ) is defined in terms of the charge position density p(r) 
as (r 2 ) = J r 2 p(r)d D r, and (p 2 ) is given in terms of the momentum density iT(p) 
in an analogous way, where n(p) is defined by means of the Fourier transform of 
•F(ri,...,rtf), <£(pi,...,p;v), as 

H(p) = J |#( P ,P2,...,Pn)| 2 ^P2...</V- d-87) 

The Fisher information has been used as a measure of uncertainty in quantum 
physics (See e. g. [80] [KH] [EU MM DM CES] OK] [[07] QUI [[09] QT0)). It has 
been shown to fulfill the Stam inequalities 111 1 II 

/ P <4(p 2 ); h<A(r 2 ), (1.88) 

and the Cramer-Rao inequalities fl59l[TO0l[Tra[TT2l[TT3ll 

D 2 D 2 
h> W y h> W) d.89) 

for the general single-particle systems. The multiplication of each pair of these in- 
equalities produces 

p^y</p/,<16(r 2 )(p 2 ), (1.90) 

valid for ground and excited states of general systems, which shows the close con- 
nection between the Heisenberg-like uncertainty product and the product of the po- 
sition and momentum Fisher informations. 

Indeed, taken into account 1 /D(r 2 ) > J p 111 141 one has that 

^(p 2 )(r 2 )>^J p I P >l (1.91) 

and 

^(p 2 )(r 2 )>^Pp~K>l. (1.92) 

It is straightforward to show that the equality limit of these two inequalities is 
reached for Gaussian densities. 

An special case is given by a single-particle in a central potential. In this frame- 
work an uncertainty Fisher information relation was obtained in 11011 : 
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(2/ + l)H 



21(1 + 1) 

and Fisher information in position space was derived in |80l as 

I p =A(p 2 )-2(2l + l)\m\(r- 2 ) 



(1-93) 



(1.94) 



where I and m are the orbital and magnetic quantum numbers. Taking into account 
the duality of the position and momentum spaces as well as the separability of the 
wavefunction, one can express the Fisher information of the momentum distribution 
density as 

h = ^{r 2 )-2{2l+\)\m\{p- 2 ). (1.95) 

On the other hand, the radial expectation values (p 2 ) and (r~ 2 ) ((r 2 ) and (p~ 2 )) are 
related HUHD by 



(p 2 )>l(l + l)(r- 2 ), 
(r 2 )>l(l + l)(p- 2 ), 



(1.96) 
(1.97) 



and combining above expressions the fisher uncertainty-like relation dl.93l ) is ob- 
tained. 



1.3.1.3 Nonadditivity properties 

The superadditivity of the Fisher information and the subadditivity of the Shannon 
information of a probability density, can be used to prove l75l that 

I W >NI P (1.98) 

S W <NS P (1.99) 

where 

/• |v|y(n,...,r Af )| 2 | 2 

I w = / -7j—dr 1 ...dr N (1.100) 

J |f(ri,...,rA,)| 2 

and 

S w = J\W(r h ...,r N )\ 2 ]n\W(r 1 ,...,r N )\ 2 dr 1 ...dr N (1.101) 

for general A-fermion systems in three dimensions. The D-dimensional generaliza- 
tion is obvious. We will show the proof below. 

Let p (r ) a probability density on R', that is, p (r) non-negative and / p (r)dr = 1 . 
We will suppose that Fisher information and Shannon information of p(r) exits. 
Corresponding to any orthogonal decomposition R' = R r © R s , t=r+s, the marginal 
densities are given by: 



Pi(x)=/ p(x,yKy, p 2 (y)=/ p(x,yK'x (1.102) 
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then una 

I P >I Pl +Ip2 (1-103) 
property which is known as superadditivity of Fisher information, and 

S P <S Pl +S Pl (1.104) 

which is known as subadditivity of Shannon information. Both inequalities saturate 
whenp(x,y) = p l (x)p 2 (y) HED . 

On the other hand, let us consider an A^-fermion system and denote the /th- 
electron density by 

p,=p(r,) = J \*¥(r l ,...,r i ,...,r N )\ z dri...dri-idr i+ i...dr N , (1.105) 

for i — l,...N. Then, taken into account that the wavefunction is antisymmetric and 
Eq. ( 11.1031 1 and (|1.104| i, the wavefunction Fisher information fullfills 

/IVIffr r )I 2 I 2 N 
l^'Z'r")! 2 dri '" dTN ~ ^ /pi =NIp ' (L1 ° 6) 

and the wavefunction Shannon information fulfills: 

r N 
S w = / |^(n,... ) r JV )| 2 ln|^(ri,...,r JV )| 2 ^ri...rfriv<^5p i =iV5p. (1.107) 

•> i=i 

Inequalities ( 11.106b and ( 11.1071 ) are equalities when |f (ri, ...,rAr)| 2 = p(rx)...p(r^). 

These properties have allowed us to generalize the following uncertainty rela- 
tionships: 

• The Stam's uncertainty relation for wave functions normalized to unity IT751I1 1 II 
is generalized via the inequality ( 11.106t by 

NI p <Iw <4N(p 2 ) (1.108) 

• The Shannon information uncertainty relation for wave functions normalized to 
unity 1 1141 is generalized via inequality j 1 . 107b by 



3AT(l+ln7r)<- / |^( ri ,...,riv)| z ln|^(ri,...,rjv)r^ri..^rjv (1.109) 



\<P(p u ...p N )\ 2 ln\<I>(p u ...,p N )\ 2 dp l ...dp N <N{Sp+S ! t) (1.110) 

where S p (S K ) denotes the Shannon information of the single-particle distribution 
density in position (momentum) space. 
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1.3.2 Fisher-Shannon product as an electronic correlation 
measure 

The Fisher-Shannon information product was earlier employed 1751 as a tool for 
stuying the electron correlation in atomic systems, in particular in two electron 
isoelectronic series. The application of this indicator to the electronic shell struc- 
ture of atoms has received a special attention for systems running from on-electron 
atoms to many-electron ones as those corresponding to the periodic table (see, e.g. 
1911 192119411971 [100)1. 

Many electron systems such as atoms, molecules and clusters show the electron 
correlation phenomenon. This feature has been characterized in terms of the correla- 
tion energy 111 161 , which gives the difference between the exact non-relativistic en- 
ergy and the Hartree-Fock approximation, as well as by some statistical correlation 
coefficients 111 171 . which asses radial and angular correlation in both the position 
and momentum density distributions. Some information-theoretic measures of the 
electron correlation in many electron systems have been proposed during last years 
G5J [US dl9j [1201 HH1 Ell OIlllIMnillinilinTjinHl. Here we will focus on 
the Fisher-Shannon Information Product as a measure of electron correlation. 

The Fisher-Shannon Information Product has been studied in two types of two- 
electron systems ll75l which differ in the Coulomb- and oscillator-like form of the 
electron-nucleus interaction. The Hamiltonian of such a system is 

H = -Iv? - \v\ + V(n) + V(r 2 ) + ] — L- p (1.111) 
2 2 l r i- r 2| 

where V(r,-) denotes the electron-nucleus interaction of the /th-electron. V (r,-) = 
Z/r,- for He-like ions (Z being the nuclear charge) and V (r,-) = A 0)rf for the Hooke 
atoms. The Hooke atom is especially well suited for the understanding of correlation 
phenomena because of its amenability to analytical treatment. 

1.3.2.1 He-like ions 

In the bare coulomb field case (BCF), i. e. without coulombic interelectronic in- 
teraction in the hamiltonian, the ground state wave function of He{Z) is a single 
Slater determinant and the charge density is a hydrogenlike one, so J Pz = ^ 

and I Pz = 4Z 2 , so Pbcf = Kbcf with Kbcf — 1.237333. To consider the inclusion 
of electronic interaction we will work with the 204-terms Hylleraas type functions 
of Koga et al. 111291 for the ground states of H , He, Li+, Be 2+ , B 3+ , and Ne 8+ 
(Z=l-5, 10). 

In Fig. ll,16l we have compared the dependence of the information product P Pz on 
the nuclear charge Z for He-like ions with the bare coulomb field information prod- 
uct. It is apparent the monotonic decrease of P pz when Z increased, asymptotically 
approaching the bare or no-correlation value Pbcf = Kbcf an d showing that the 
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electron correlation effect gradually decreases with respect to the electron-nucleus 
interaction when the nuclear charge of the system is raised up. 




Fig. 1.16 The ratio P Pz /Pbcf of the information product for the He-like ions and the information 
product for bare two-electron atoms as a function of the nuclear charge Z. The points correspond 
to the values of He(Z) ions with Z = 1 — 5 and 10. The solid line has been drawn only to guide the 
eye. 



1.3.2.2 Hooke's atoms 

For the bare oscillator-field case (BOF), it is known that J Pm = 1/ (2o) and I Pm = 
6(0, so that the information product Pbof = F On the other hand the Schrodinger 
equation of the entire Hooke atom can be solved analytically for an infinite set of os- 
cillator frequencies [ 1 30 1 . The use of relative and center of mass coordinates allows 
the Hamiltonian to be separable so that the total wavefunction for singlet states is 
given by f (n, 0i,r2,02) = 4 (R)<P(u)T(ai,02)> where 1(01,02) is the singlet spin 
wave function, % (R) and 4>(u) being the solutions of the Schrodinger equations 

(-iv| + 0)/? 2 )£(R)=£^(R), (1.112) 



(-V 2 u + \(Ou 2 + -)0(u)=E u 0(u), 
4 u 



(1.113) 
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CO 

Fig. 1.17 The information product P P(i1 /Pbof f° r the Hooke atoms with the oscillator strength 
£0 = 0.5, 0.1, 0.03653727, 0.01734620, 0.009578420, and 0.005841700 and the bare oscilator 
field information product Pbof ■ The solid line has been drawn only to guide the eye. 

respectively, and the total energy E = Er + E u . 

The computed results for the Fisher information and entropy power of these sys- 
tems are shown in Fig. 11.171 for several CO values, (namely, 0.5, 0.1, 0.03653727, 
0.01734620, 0.009578420, and 0.005841700).For these particular values the ground 
state solution can be obtained 11301 as 

£(R)= (^y 4 e- aRl a nd<P(u)=e-^Q n (r) (1.114) 

where Q„(r) is a polynomial whose coefficients can be determined analytically. 

Cioslowski et al 11311 quantify the domains of the weakly correlated regime of 
this system which corresponds to the values of co greater than co c ~ 4.011624 x 
10~ 2 , and the strongly correlated regime that encompasses the values of co smaller 
than co c . 

In Fig. 11.171 we have drawn Pp^/PsoF as a function of the oscillator electron- 
nucleus strength CO. It is apparent that the value of the electron density functional 
Ppa/PBOF (dots) is always bigger than unity, when the electron-electron repulsion 
becomes very small with respect to the oscillator electron-nucleus interaction, the 
points approach to the value 1, indicating the decrease of the relative importance of 
electron correlation when the strength CO is increased. 
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1.3.3 Fisher information for a single particle in a central potential 



As another application, let us consider the Fisher information in the position space 
(for momentum space is analogous) of a single-particle system in a central potential 
V(r), defined by 

|Vp(r)| 2 



P(r) 



-dr 



(1.115) 



where p(r) = |y/(r)| 2 and where \j/(r) is the bound solutions of the Schrodinger 
equation 



\v 2 + V(r) 



\lf(r)=E\jf(r). 

For bounded states the solution of above equation is given by 

Wnim(r) = R ni {r)Yi m (Q) 



(1.116) 



(1.117) 



where R„i{r) is the radial part of the function and Y[ m (Q) is the spherical harmonic 
of order I that is given by 

Y lm (£2 ) = -^ e im ^ & tm (cos 0), (-/ < m < I and O<0<7T,O<(/)<27r) 
•Jin 



(1.118) 

where ®\ m {x) are given in terms of the associated Legendre functions of the first 
kindP/"(x): 



®lm(x) 



121+1 (l-m) 



(1.119) 



2 (l + m) 

So the Fisher information for a single particle in a central potential is given by 



^,„=4/|Vp,f(r)| 2 



V dr 

on the other hand the kinetic energy is given by: 



(P 2 )nlm = J |VV/„/ m (r)| 
V2 R nM 



dR n i{r 
dr 

2 



\Yi m (Q)\' 



dr 



dr, 
(1.120) 



thus 



I Pnlm = 4 (p 2 )nim-2(r- 2 ) nlm (2l + l)\m\ 



dtl.121) 



(1.122) 
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1.3.3.1 Hydrogen atom 

Forthis system the potential is V(r) = — 1/randthe expectation values (p 2 ) n i„, = -K 
and {r 2 ) nlm = (2/+ 2 1>i3 thus 



1.3.3.2 Isotropic harmonic oscillator 

In this case the potential is V(r) = \(0 2 r 2 and the expectation values (p 2 ) n im 
(0(2n + 1 + §) and (r- 2 ) nlm = 



I Pnlm =4co(2n + l+--\m\) (1.124) 



1.4 Applications to Quantum Systems 

1.4.1 Formulas in position and momentum spaces 

Here, we summarize the formulas and the nomenclature that will use in all this 
section. 

The measure of complexity C has been defined as 

C = HD, (1.125) 

where H represents the information content of the system and D gives an idea of 
how much concentrated is its spatial distribution. 

The simple exponential Shannon entropy, in the position and momentum spaces, 
takes the form, respectively, 

H, =e s > , H p = e s P, (1.126) 

where S r and S p are the Shannon information entropies, 

5 r = -|p(r)logp(r)dr, S p = -|y(p) logy(p) dp , (1.127) 

and p(r) and y(p) are the densities normalized to 1 of the quantum system in posi- 
tion and momentum spaces, respectively. 
The disequilibrium is: 
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D r = J p 2 (r) dr , D p = J f(p) dp , (1.128) 

In this manner, the final expressions for C in position and momentum spaces are: 

C r =H r D r , C p = H p D p . (1.129) 

Second, the Fisher-Shannon information, P, in the position and momentum 
spaces, is given respectively by 

P r =J r I r , P P =J P -I P , (1.130) 

where the first factor 

/= — e 2s '/ 3 / = — e 2 V3 (1131) 

is a version of the exponential Shannon entropy, and the second factor 

, [VpW] 2 , , f [vy(p)] 2 , r11 „, 



is the Fisher information measure, that quantifies the narrowness of the probability 
density. 



1.4.2 TheH-atom 



The atom can be considered a complex system. Its structure is determined through 
the well established equations of Quantum Mechanics 0132111331 . Depending on the 
set of quantum numbers defining the state of the atom, different conformations are 
available to it. As a consequence, if the wave function of the atomic state is known, 
the probability densities in the position and the momentum spaces are obtained, and 
from them, the different statistical magnitudes such as Shannon and Fisher informa- 
tions, different indicators of complexity, etc., can be calculated. 

These quantities enlighten new details of the hierarchical organization of the 
atomic states. In fact, states with the same energy can display, for instance, different 
values of complexity. This is the behavior shown by the simplest atomic system, that 
is, the hydrogen atom (H-atom). Now, we present the calculations for this system 

The non-relativistic wave functions of the //-atom in position space (r = (r, Q), 
with r the radial distance and Q the solid angle) are: 

f„,/. m (r)=/?„,/(r)F /im (i2), (1.133) 

where R n ,i{r) is the radial part and Yi >m (Q) is the spherical harmonic of the atomic 
state determined by the quantum numbers (n,l,m). The radial part is expressed as 
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being L«(f) the associated Laguerre polynomials. Atomic units are used here. 

The same functions in momentum space (p = (p,Q), with p the momentum 
modulus and Q. the solid angle) are: 

where the radial part R n j(p) is now given by the expression HI 341 
- , , \2 (n-/-l)n x /2 



7T (« + /)! 



n 2 ? 2/+2„ "P W+l f »V-1 \ 

(«V+iy+ 2 v '->y+ij 



(1.136) 

with C«(f) the Gegenbauer polynomials. 

Taking the former expressions, the probability density in position and momentum 
spaces, 

P(r) = I S^/, m (r) | 2 , 7(p) = | %,, m (p) I 2 , d-137) 

can be explicitly calculated. From these densities, the statistical complexity and the 
Fisher-Shannon information are computed. 

C r and C p (see expression ( 11.129b ) are plotted in Fig. 11.181 as function of the 
modulus of the third component m of the orbital angular momentum / for different 
pairs of (n,l) values. The range of the quantum numbers is: n > 1, < I < n — 1, 
and — / < m < I. Fig. 11.1 8f a~) shows C r for n = 15 and Fig. 11.181 b) shows C r for 
n = 30. In both figures, it can be observed that C, splits in different sets of discrete 
points. Each one of these sets is associated to a different / value. It is worth to note 
that the set with the minimum values of C r corresponds just to the highest /, that is, 
l = n — l. The same behavior can be observed in Figs. ll.18l c) and ll,18f d) for C p . 

Fig. |1.19| shows the calculation of P r and P p (see expression dl.l301 l) as function 
of the modulus of the third component m for different pairs of («,/) values. The 
second factor, I r or I p , of this indicator can be analytically obtained in both spaces 
(position and momentum). The results are l80l : 

/,. = 4fl- M Y (1.138) 

I p = 2n 2 (5« 2 + l-3/(/+l)-(8«-3(2/+l)) \m\) . (1.139) 

In Fig. [TT9l a). P, is plotted for n = 15, and P, is plotted for n = 30 in Fig. [TT9l b). 
Here P, also splits in different sets of discrete points, showing a behavior parallel 
to the above signaled for C (Fig. 11.181 . Each one of these sets is also related with a 
different I value. It must be remarked again that the set with the minimum values of 
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Fig. 1.18 Statistical complexity in position space, C,-, and momentum space, C„, vs. \m\ for differ- 
ent (n, /) values in the hydrogen atom. C r for (a) n = 15 and (b) n = 30. C p for (c) « = 15 and (d) 
n — 30. All values are in atomic units. 



P r corresponds just to the highest /. In Figs. ll.19l c) and ll,19f d). the same behavior 
can be observed for P p . 

Then, it is put in evidence that, for a fixed level of energy n, these statistical 
magnitudes take their minimum values for the highest allowed orbital angular mo- 
mentum, / = n — 1 . It is worth to remember at this point that the mean radius of an 
(«,/ = n — l) orbital, < r >„j, is given by 111351 

<r >„,/=„_!= » 2 (! + ^)' (1-140) 

that tends, when n is very large, to the radius of the nth energy level, rg /, r = n 2 , 
of the Bohr atom. The radial part of this particular wave function, that describes the 
electron in the (n, I = n— 1) orbital, has no nodes. In fact, if we take the standard de- 
viation, (Ar) =< (r— < r >) 2 > 1 / 2 , of this wave function, (Ar) = ny/2n + 1/2, the 
ratio (Ar)/ < r > becomes l/v2« for large n. This means that the spatial configu- 
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ration of this atomic state is like a spherical shell that converges to a semiclassical 
Bohr-like orbit when n tends to infinity. These highly excited //-atoms are referred 
as Rydberg atoms, that have been intensively studied [ 1 36 1 for its importance in ar- 
eas as astrophysics, plasma physics, quantum optics, etc., and also in studies of the 
classical limit of quantum mechanics Ml 371 . 
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Fig. 1.19 Fisher-Shannon information in position space, P r , and momentum space, P p , vs. \m\ for 
different (n, I) values in the hydrogen atom. P r for (a) n = 15 and (b) n = 30. P r for (c) n = 15 and 
(d) n = 30. All values are in atomic units. 



We conclude this section by remarking that the minimum values of these statis- 
tical measures calculated from the quantum wave functions of the //-atom enhance 
our intuition by selecting just those orbitals that for a large principal quantum num- 
ber converge to the Bohr-like orbits in the pre-quantum image. Therefore, these 
results show that insights on the structural conformation of quantum systems can be 
inferred from these magnitudes, as it can also be seen in the next sections. 
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1.4.3 The quantum harmonic oscillator 



As suggested in the previous section, a variational process on the statistical measures 
calculated in the //-atom could select just those orbitals that in the pre-quantum im- 
age are the Bohr-like orbits. Now, we show that a similar behavior for the statistical 
complexity and Fisher-Shannon information is also found in the case of the isotropic 
quantum harmonic oscillator ||9T1 . 

We recall the three-dimensional non-relativistic wave functions of this system 
when the potential energy is written as V(r) = A 2 r 2 /2, with A a positive real con- 
stant expressing the potential strength. In the same way as in the //-atom (Eq. 
( 11.1331 ). these wave functions in position space (r = (r,Q), with r the radial dis- 
tance and Q the solid angle) are: 



(1.141) 



where R„j(r) is the radial part and F/ m (i2) is the spherical harmonic of the quantum 
state determined by the quantum numbers (n,l, m). Atomic units are used here. The 
radial part is expressed as 11 1 3 81 



2n!A'+ 3 / 2 
r(n + 1 + 3/2) 



I 1 / 2 



r' C l/2 (Xr 2 ) 



(1.142) 



where L„ (t) are the associated Laguerre polynomials. The levels of energy are given 
by 

E nJ = A (2« + / + 3/2) = A (e n> i + 3/2) , ( 1 . 143) 

where n = 0, 1,2,- ■■ and I = 0, 1,2,- ■■, Let us observe that e n i = 2n + l. Thus, 
different pairs of (n,l) can give the same e n /, and then the same energy E n /. 

The wave functions in momentum space (p = (p,Q), with p the momentum 
modulus and C2 the solid angle) present the same form as in the //-atom (Eq. ll. 1351 ): 



where the radial part R„j(p) is now given by the expression [ 138 1 



RnAP) 



2n\X- l -y 2 
r{n + 1 + 3/2) 



1/2 



p l e-h L l n +l l\p 2 /X) 



(1.144) 



(1.145) 



Taking the former expressions, the probability density in position and momentum 
spaces, 



n(P) = I %,l,n(P) 



(1.146) 



can be explicitly calculated. From these densities, the statistical complexity (see 
expression (11.129b ) and the Fisher-Shannon information (see expression ( 1 1.1 301 )) 
are computed. It is shown in section 11.4.3.11 that these quantities are independent 
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Fig. 1.20 Statistical complexity in position space, C r , and momentum space, C p , vs. \m\ for dif- 
ferent energy ^/-values in the quantum isotropic harmonic oscillator for (a) e„j = 15 and (b) 
e„j = 30. Recall that C,- = C p . All values are in atomic units. 



of A, the potential strength, and also that they are the same in both position and 
momentum spaces, i.e. C r = C p and P, = P p . 

In Fig. 1 1 .201 C r (or C p ) is plotted as function of the modulus of the third compo- 
nent m, —I < m< I, of the orbital angular momentum / for different I values with 
a fixed energy. That is, according to expression (11.143b , the quantity e n \ =2n + l is 
constant in each figure. Fig. 11.201' a") shows C r for e„ / = 15 and Fig. ll.20l b) shows 
C, for e„ J = 30. In both figures, it can be observed that C, splits in different sets of 
discrete points. Each one of these sets is associated to a different / value. It is worth 
noting that the set with the minimum values of C r corresponds just to the highest I, 
that is, / = 15 in Fig. [L20l a) and I = 30 in Fig. lQDT b). 

Fig. 1 1.21 1 shows P as function of the modulus of the third component m for dif- 
ferent pairs of (e„ j =2n + l,l) values. The second factor, /, or I p , of this indicator 
can be analytically obtained in both spaces (position and momentum) 15D1 : 

I r = A{2n + l + 3/2-\m\)X, (1.147) 
I p = 4(2« + / + 3/2- |m|)A _1 . (1.148) 

Let us note that /, and I p depend on A, although the final result for P r and P p are non 
A-dependent (see section [T.4.3.U . In Fig. ll.2ll a). P, (or P p ) is plotted for e„ / = 15, 
and P r is plotted for e n \ = 30 in Fig. ll.2U b). Here, P,- also splits in different sets 
of discrete points, showing a behavior similar to that of C in Fig. 11.201 Each one of 
these sets is related with a different I value, and the set with the minimum values of 
P r also corresponds just to the highest /, that is, / = 15 and / = 30, respectively. 

As in the //-atom, we also see here that, for a fixed level of energy, let us say 
e n j = 2n + 1, these statistical quantities take their minimum values for the highest 
allowed orbital angular momentum, / = e n j. It is worth remembering at this point 
that the radial part of this particular wave function, that describes the quantum sys- 
tem in the (n = 0,/ = e„/) orbital, has no nodes. This means that the spatial con- 
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Fig. 1.21 Fisher-Shannon information in position space, P r , and momentum space, P p , vs. \m\ for 
different energy e„,/-values in the quantum isotropic harmonic oscillator, for (a) e„j = 15 and (b) 
e„j = 30. Recall that P r = P p . All values are in atomic units. 



figuration of this state is, in some way, a spherical-like shell. In section fT.4.3.21 the 
mean radius of this shell, < r >„,/.„„ is found for the case (n =0,1 = e„i,m). This 
is: 

< r >n=0,l=e n , h m=< r >, I=0 j = ,„,~ y/x~ 1 (e nJ + 1 ) (l + ©(e^ 1 )) , (1.149) 

that tends, when e n j ^> 1, to the radius of the Nth energy level, = \/X~ l (N + 1), 
taking = e,,./ in the Bohr-like picture of the harmonic oscillator (see section 
11.4.3.21 1. 

Then, we can remark again that the minimum values of the statistical measures 
calculated from the wave functions of the quantum isotropic harmonic oscillator 
also select just those orbitals that in the pre-quantum image are the Bohr-like orbits. 



1.4.3.1 Invariance of C and P under rescaling transformations 



Here, it is shown that the statistical complexities C, and C p are equal and indepen- 
dent of the strength potential, X, for the case of the quantum isotropic harmonic 
oscillator. Also, the same behavior is displayed by P r and P p . 

For a fixed set of quantum numbers, (n,l,m), let us define the normalized proba- 
bility density p(t): 



P(0 



2n\ 



t 21 e-' Z 



r'+l/2/,2 



it 1 ) [YiA^Y 



r(n + 1 + 3/2) 

From expressions ( I1.14U . (11.1421 and ( 11.146l l. it can be obtained that 



(1.150) 



p A (r)=A 3 / 2 p(A I /2 r ), 



(1.151) 
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where p A is the normalized probability density of expression (11.146b . Now, it is 
straightforward to find that 

H r (p x )=X-^ 2 H(p), (1.152) 

and that 

D r (p A )=A 3 / 2 D(p). (1.153) 

Then, 

C r ( Pl )=C( P ), (1.154) 

and the non A -dependence of C r is shown. 

To show that C, and C p are equal, let us note that, from expressions (11. 1441 ). 
( 11.145b and (11.146b , the normalized probability density "fx (p) for the same set of 
quantum numbers (n,l,m) can be written as 



n(p)=X-V 2 p(l-V 2 p). (1.155) 

H p (y x )=X i ' 2 H(p) 1 (1.156) 

D p ( n )=X-V 2 D(p). (1.157) 

C p (n)=C(P), (1.158) 

and the equality of C r and C p , and their non A -dependence are shown. 

Similarly, from expressions ( 11.1301 ), dl-131b . ( 11.147b and ( 11.148b . it can be found 
that P r = P p , and that these quantities are also non A -dependent. 



Now, it is found that 

and that 

Then, 



1.4.3.2 Bohr-like orbits in the quantum isotropic harmonic oscillator 

Here, the mean radius of the orbital with the lowest complexity is calculated as 
function of the energy. Also, the radii of the orbits in the Bohr picture are obtained. 

The general expression of the mean radius of a state represented by the wave 
function %j, m is given by 



< r >n,l,m = < r >„,/= 



1 



r(n + / + 3/2) A 1 / 2 Jo 



t ,+l e~' 



L' n ^ 2 (t) 



dt. (1.159) 



For the case of minimum complexity (see Fig. |1.20| or |1.21b , the state has the quan- 
tum numbers (n = 0,1 = e„ [). The last expression (11. 159b becomes: 



< r > n =0,l=e„ r 



(«»,« + 1)1 



r( en , + 3/2)AV2 ' 



(1.160) 



that, in the limit e n j ^> 1, simplifies to expression (11. 149b : 
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<^> n =o,/= e „,,»i- ^X-'{e n ., + \)(\+&{e-])y (1.161) 

Now we obtain the radius of an orbit in the Bohr-like image of the isotropic 
harmonic oscillator. Let us recall that this image establishes the quantization of the 
energy through the quantization of the classical orbital angular momentum. So, the 
energy £ of a particle of mass m moving with velocity v on a circular orbit of radius 
r under the harmonic potential V (r) = mX 2 r 2 /2 is: 

E = -ml 2 r 2 + -mv 2 . (1.162) 
2 2 

The circular orbit is maintained by the central force through the equation: 

2 

— = mX 2 r. (1.163) 
r 

The angular momentum takes discrete values according to the condition 

mvr= {N+l)h (N = 0,1,2,...). (1.164) 

Combining the last three equations dl.162t - dl.164t . and taking atomic units, m = 
k = 1, the radius rm of a Bohr-like orbit for this system is obtained 



r N = y Jk- 1 (N+l) (AT = 0,1,2,...). (1.165) 

Let us observe that this expression coincides with the quantum mechanical radius 
given by expression (11.161b when e n \ = N for N ^> 1. 



1.4.4 The square well 

Statistical complexity has been calculated in different atomic systems, such as in 
the H atom (Sec. I1.4.2t and in the quantum harmonic oscillator (Sec. I1.4.3t . The 
behavior of this statistical magnitude in comparison with that of the energy displays 
some differences. Among other applications, the energy has a clear physical mean- 
ing II 1321 and it can be used to find the equilibrium states of a system. In the same 
way, it has also been shown that the complexity can give some insight about the 
equilibrium configuration in the ground state of the H£ molecule ||98l . In this case, 
Montgomery and Sen have reported that the minimum of the statistical complex- 
ity as a function of the internuclear distance for this molecule is an accurate result 
comparable with that obtained with the minimization of the energy. This fact could 
suggest that energy and complexity are two magnitudes strongly correlated for any 
quantum system. But this is not the general case. See, for example, the behavior 
of both magnitudes in the previous sections for the H-atom and for the quantum 
isotropic harmonic oscillator. In both systems, the degeneration of the energy is 
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split by the statistical complexity, in such a way that the minimum of complexity for 
each level of energy is taken on the wave function with the maximum orbital angular 
momentum. Therefore, energy and complexity are two independent variables. 

In this section, we wonder if there exists a quantum system where degeneration of 
the complexity can be split by the energy. The answer will be affirmative II 1391 . We 
show it in two steps. First, a new type of invariance by replication for the statistical 
complexity is established, and, second, it is seen that the energy eingestates of the 
quantum infinite square well fulfill the requirements of this kind of invariance. From 
there, it is revealed that the degeneration of complexity in this quantum system is 
broken by the energy. 

Different types of replication can be defined on a given probability density. One 
of them was established in Ref. |53l . Here, a similar kind of replication is presented, 
in such a manner that the complexity C of m replicas of a given distribution is equal 
to the complexity of the original one. Thus, if R represents the support of the density 
function p(x), with J R p(x)dx = 1, take « copies p m (x), m = l,--- ,n, of p(x), 

Pm(x) = p(n(x- X m )) , \<m<n, (1.166) 

where the supports of all the p m {x), centered at X' m s points, m = 1, •••,«, are all 
disjoint. Observe that f R p m (x)dx = i, what makes the replicas union 

n 

1n(x) = Y j p m (x) (1.167) 

1=1 

to be also a normalized probability distribution, / R q„ (x) dx = 1 . For every p m (x), a 
straightforward calculation shows that the Shannon entropy is 

S(p m ) = -S(p), (1.168) 
n 

and the disequilibrium is 

D( Pm ) = -D(p). (1.169) 
n 

Taking into account that the m replicas are supported on disjoint intervals on R, 
we obtain 

S(q n )=S(p), (1.170) 
D(q n ) = D(p). (1.171) 
Then, the statistical complexity (C = e s ■ D) is 

C(q n )=C(p), (1.172) 

and this type of invariance by replication for C is shown. 

Let us see now that the probability density of the eigenstates of the energy in the 
quantum infinite square well display this type of invariance. The wave functions rep- 
resenting these states for a particle in a box, that is confined in the one-dimensional 
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interval [0,L], are given by Ml 401 



<Pk{x) 




(1.173) 



Taking p(x) as the probability density of the fundamental state (k 



p(x)=\(pi(x) | 2 , 



(1.174) 



the probability density of the kth excited state, 



=1 <Pk(x) | 2 , 



(1.175) 



can be interpreted as the union of k replicas of the fundamental state density, p(x), 
in the k disjoint intervals \(m — l)L/k,mL/k], with m = 1,2,. ..,k. That is, we find 
expression (11.167b , q^{x) = £* =1 p m (x), with 



where in this case the X' m s of expression (11.166b are taken as (m— l)L/k. Therefore, 
we conclude that the complexity is degenerated for all the energy eigenstates of the 
quantum infinite square well. Its value can be exactly calculated. Considering that L 
is the natural length unit in this problem, we obtain 



In the general case of a particle in a cZ-dimensional box of width L in each dimension, 
it can also be verified that complexity is degenerated for all its energy eigenstates 
with a constant value given by C = (3/e) d . 

Here we have shown that, in the same way that the complexity breaks the energy 
degeneration in the H-atom and in the quantum isotropic harmonic oscillator, the 
contrary behavior is also possible. In particular, the complexity is constant for the 
whole energy spectrum of the of-dimensional quantum infinite square well. This 
result is due to the same functional form displayed by all the energy eigenstates of 
this system. Therefore, it suggests that the study of the statistical complexity in a 
quantum system allows to infer some properties on its structural conformation. 



1.4.5 The periodic table 

The use of these statistical magnitudes to study the electronic structure of atoms 
is another interesting application J63] |87] MB E2 EH EU [145] [146) . The basic 
ingredient to calculate these statistical indicators is the electron probability density, 
p(r), that can be obtained from the numerically derived Hartree-Fock atomic wave 




(1.176) 



C(p)=C( ft ) = - = 1.1036... 



(1.177) 



e 
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function in the non-relativistic case 11411 11421 . and from the Dirac-Fock atomic 
wave function in the relativistic case 111431 . The behavior of these statistical quan- 
tifiers with the atomic number Z has revealed a connection with physical measures, 
such as the ionization potential and the static dipole polarizability 11871 . All of them, 
theoretical and physical magnitudes, are capable of unveiling the shell structure of 
atoms, specifically the closure of shells in the noble gases. Also, it has been observed 
that statistical complexity fluctuates around an average value that is non-decreasing 
as the atomic number Z increases in the non-relativistic case 1142111431 . This aver- 
age value becomes increasing in the relativistic case 01431 . This trend has also been 
confirmed when the atomic electron density is obtained with a different approach 
II 1471 . In another context where the main interactions have a gravitational origin, as 
it is the case of a white dwarf, it has also been observed that complexity grows as 
a function of the star mass, from the low-mass non-relativistic case to the extreme 
relativistic limit. In particular, complexity for the white dwarf reaches a maximum 
finite value in the Chandrasekhar limit as it was calculated by Sanudo and Lopez- 
Ruiz 0481 . 



t 1 i 1 | 1 1 r 1 1 1 p 1 1 1 1 1 r 1 1 1 r 




Fig. 1.22 Statistical complexity, C, vs. Z in the non relativistic case (C NR ). The dashed lines indi- 
cate the position of noble gases. For details, see the text. 

An alternative method to calculate the statistical magnitudes can be used when 
the atom is seen as a discrete hierarchical organization. The atomic shell structure 
can also be captured by the fractional occupation probabilities of electrons in the 
different atomic orbitals. This set of probabilities is here employed to evaluate all 
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Z 

Fig. 1.23 Statistical complexity, C, vs. Z in the relativistic case (C R ). The comments given in Fig. 
I1.22l are also valid here. 

these quantifiers for the non-relativistic (NR) and relativistic (R) cases. In the NR 
case, a non-decreasing trend in complexity as Z increases is obtained and also the 
closure of shells for some noble gases is observed If94l ll49l . 

For the NR case, each electron shell of the atom is given by (nl) w 111501 . where 
n denotes the principal quantum number, I the orbital angular momentum (0 < I < 
n — 1) and w is the number of electrons in the shell (0 < w < 2(21 + 1)). For the R 
case, due to the spin-orbit interaction, each shell is split, in general, in two shells 
|[T5T1 : (nlj-) w -, (nlj+) w +, where j± =l± 1/2 (for / = only one value of j is 
possible, j = j + = 1 /2) and < w± < 2j± + 1. As an example, we explicitly give 
the electron configuration of Ar(Z = 18) in both cases, 

Ar(NR) : (ls) 2 (2s) 2 (2p) 6 (3s) 2 (3p) 6 , (1.178) 

Ar(R) : (lsl/2) 2 (2sl/2) 2 (2pl/2) 2 (2p3/2)\3sl/2) 2 (3pl/2) 2 (3 P 3/2) 4 . (1.179) 

For each atom, a fractional occupation probability distribution of electrons in 
atomic orbitals {p^}, k = 1,2, ... ,77, being 77 the number of shells of the atom, 
can be defined. This normalized probability distribution {pk} (T.Pk = 1) is easily 
calculated by dividing the superscripts w± (number of electrons in each shell) by Z, 
the total number of electrons in neutral atoms, which is the case we are considering 
here. The order of shell filling dictated by nature [150] has been chosen. Then, from 
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this probability distribution, the different statistical magnitudes (Shannon entropy, 
disequilibrium, statistical complexity and Fisher-Shannon entropy) is calculated. 

In order to calculate the statistical complexity C = H D, with H = e s , we use the 
discrete versions of the Shannon entropy S and disequilibrium D: 

n 

S = - J>tlogp t , (1.180) 

k=\ 

n 

d= £( w -i/n) 2 . (1.181) 

k=\ 

To compute the Fisher-Shannon information, P = J I, with J = ^ e 2S ' 3 , the dis- 
crete version of / is defined as (94] 11491 

I= y (PM-Pk) 2 (1182) 

where pn+i — is taken. 




The statistical complexity, C, as a function of the atomic number, Z, for the NR 
and R cases for neutral atoms is given in Figs. 11.221 and 11.231 respectively. It is 
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Fig. 1.25 Fisher-Shannon entropy, P, vs. Z, in the relativistic case (P R ). The comments given in 
Fig. ll.24l are also valid here. 

observed in both figures that this magnitude fluctuates around an increasing average 
value with Z. This increasing trend recovers the behavior obtained by using the 
continuous quantum-mechanical wave functions 1 1421 11431 . A shell-like structure is 
also unveiled in this approach by looking at the minimum values of C taken on the 
noble gases positions (the dashed lines in the figures) with the exception of Ne{Z = 
10) and Ar(Z =18). This behavior can be interpreted as special arrangements in the 
atomic configuration for the noble gas cases out of the general increasing trend of C 
with Z. 

The Fisher-Shannon entropy, P, as a function of Z, for the NR and R cases in 
neutral atoms is given in Figs. 11.241 and 11.251 respectively. The shell structure is 
again displayed in the special atomic arrangements, particularly in the R case (Fig. 
I1.251 l where P takes local maxima for all the noble gases (see the dashed lines on 
Z = 2, 10, 18,36,54,86). The irregular filling (i.f.) of s and d shells lfl50l is also 
detected by peaks in the magnitude P, mainly in the R case. In particular, see the 
elements Cr and Cu (i.f. of As and 3d shells); Nb, Mo, Ru, Rh, and Ag (i.f. of 5s and 
Ad shells); and finally Pt and Au (i.f. of 6s and 5d shells). Pd also has an irregular 
filling, but P does not display a peak on it because the shell filling in this case does 
not follow the same procedure as the before elements (the 5s shell is empty and the 
5d is full). Finally, the increasing trend of P with Z is clearly observed. 

Then, it is found that P, the Fisher-Shannon entropy, in the relativistic case (Fig. 
II. 25b reflects in a clearer way the increasing trend with Z, the shell structure in noble 
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gases, and the irregular shell filling of some specific elements. The same method that 
uses the fractional occupation probability distribution is applied in the next section 
to another many particle system, the atomic nucleus, that has also been described 
by a shell model. 



1.4.6 Magic numbers in nuclei 

Nucleus is another interesting quantum system that can be described by a shell 
model 11521 . In this picture, just as electrons in atoms, nucleons in nuclei fill in 
the nuclear shells by following a determined hierarchy. Hence, the fractional occu- 
pation probabilities of nucleons in the different nuclear orbitals can capture the nu- 
clear shell structure. This set of probabilities, as explained in the above section, can 
be used to evaluate the statistical quantifiers for nuclei as a function of the number 
of nucleons. In this section, by following this method, the calculation of statistical 
complexity and Fisher-Shannon information for nuclei is presented 11531 . 

The nuclear shell model is developed by choosing an intermediate three-dimensional 
potential, between an infinite well and the harmonic oscillator, in which nucle- 
ons evolve under the Schrodinger equation with an additional spin-orbit interaction 
11521 . In this model, each nuclear shell is given by (nlj) w , where / denotes the or- 
bital angular momentum (/ = 0, 1,2, . . .), n counts the number of levels with that / 
value, j can take the values / + 1/2 and / — 1/2 (for 1 = only one value of j is pos- 
sible, j = 1 /2), and w is the number of one-type of nucleons (protons or neutrons) 
in the shell (0 < w < 2j + 1). 

As an example, we explicitly give the shell configuration of a nucleus formed by 
Z = 20 protons or by N = 20 neutrons. In both cases, it is obtained 11521 : 



When one-type of nucleons (protons or neutrons) in the nucleus is considered, 
a fractional occupation probability distribution of this type of nucleons in nuclear 
orbitals {pk}, k = 1,2, ... , IT, being IT the number of shells for this type of nucleons, 
can be defined in the same way as it has been done for electronic calculations in the 
atom in the previous section. This normalized probability distribution {p^} (£<Pk = 
1 ) is easily found by dividing the superscripts w by the total of the corresponding 
type of nucleons (Z or N). Then, from this probability distribution, the different 
statistical magnitudes (Shannon entropy, disequilibrium, statistical complexity and 
Fisher-Shannon entropy) by following expressions dl.180Hl.182t are obtained. 

The statistical complexity, C, of nuclei as a function of the number of nucleons, 
Z or N, is given in Fig. 11.261 Here we can observe that this magnitude fluctuates 
around an increasing average value with Z or N. This trend is also found for the 
electronic structure of atoms (see previous section), reinforcing the idea that, in 
general, complexity increases with the number of units forming a system. However, 




: (M/2) 2 (lp3/2) 4 (lpl/2) 2 (W5/2) 6 (2sl/2) 2 (W3/2) 4 . (1.183) 
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Fig. 1.26 Statistical complexity, C, vs. number of nucleons, Z or iV. The dashed lines indicate the 
positions of magic numbers {2, 8, 20, 28, 50, 82, 126, 184}. For details, see the text. 

the shell model supposes that the system encounters certain ordered rearrangements 
for some specific number of units (electrons or nucleons). This shell-like structure 
is also unveiled by C in this approach to nuclei. In this case, the extremal values 
of C are not taken just on the closed shells as happens in the noble gases positions 
for atoms, if not that they appear to be in the positions one unit less than the closed 
shells. 

The Fisher-Shannon entropy, P, of nuclei as a function of Z ox N is given in 
Fig. 11.271 It presents an increasing trend with Z or N. The spiky behavior of C pro- 
voked by the nuclear shell structure becomes smoother for P, that presents peaks 
(changes in the sign of the derivative) only at a few Z or N, concretely at the num- 
bers 2,6,14,20,28,50,82,126,184. Strikingly, the sequence of magic numbers is 
{2,8,20,28,50,82,126,184} (represented as dashed vertical lines in the figures). 
Only the peaks at 6 and 14 disagree with the sequence of magic numbers, what 
could be justified by saying that statistical indicators work better for high numbers. 
But in this case, it should be observed that the carbon nucleus, C^Tg , and the silicon 
nucleus, Si^Zu^ apart from their great importance in nature and industry, they are 
the stable isotopes with the greatest abundance in the corresponding isotopic series, 
98.9% and 92.2%, respectively. 
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Fig. 1.27 Fisher-Shannon entropy, P, vs. the number of nucleons, Z or N. The dashed lines indicate 
the positions of magic numbers {2. 8, 20, 28, 50, 82, 126, 184}. For details, see the text. 



Then, the increasing trend of these statistical magnitudes with Z or N, and the 
reflect of the shell structure in the spiky behavior of their plots are found when using 
for their calculation the fractional occupation probability distribution of nucleons, 
Z or N. It is worth to note that the relevant peaks in the Fisher-Shannon information 
are revealed to be just the series of magic numbers in nuclei. This fact indicates 
again that these statistical indicators are able to enlighten some structural aspects of 
quantum many-body systems. 
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Chapter 1 

Statistical Complexity and Fisher-Shannon 
Information. Applications 



Abstract In this chapter, a statistical measure of complexity and the Fisher-Shannon 
information product are introduced and their properties are discussed. These mea- 
sures are based on the interplay between the Shannon information, or a function of 
it, and the separation of this set of states from the equiprobability distribution, i.e. 
the disequilibrium or the Fisher information, respectively. Different applications in 
discrete and continuous systems are shown. Some of them are concerned with quan- 
tum systems, from prototypical systems such as the H-atom, the harmonic oscillator 
and the square well to other ones such as He-like ions, Hooke 's atoms or just the pe- 
riodic table. In all of them, these statistical indicators show an interesting behavior 
able to discern and highlight some conformational properties of those systems. 
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1.1 A Statistical Measure of Complexity. Some Applications 

This century has been told to be the century of complexity (TJ. Nowadays the ques- 
tion "what is complexity?" is circulating over the scientific crossroads of physics, 
biology, mathematics and computer science, although under the present understand- 
ing of the world could be no urgent to answer this question. However, many different 
points of view have been developed to this respect and hence a lot of different an- 
swers can be found in the literature. Here we explain in detail one of these options. 

On the most basic grounds, an object, a procedure, or system is said to be "com- 
plex" when it does not match patterns regarded as simple. This sounds rather like 
an oxymoron but common knowledge tells us what is simple and complex: simpli- 
fied systems or idealizations are always a starting point to solve scientific problems. 
The notion of "complexity" in physics (HE] starts by considering the perfect crystal 
and the isolated ideal gas as examples of simple models and therefore as systems 
with zero "complexity". Let us briefly recall their main characteristics with "order", 
"information" and "equilibrium". 

A perfect crystal is completely ordered and the atoms are arranged following 
stringent rules of symmetry. The probability distribution for the states accessible to 
the perfect crystal is centered around a prevailing state of perfect symmetry. A small 
piece of "information" is enough to describe the perfect crystal: the distances and the 
symmetries that define the elementary cell. The "information" stored in this system 
can be considered minimal. On the other hand, the isolated ideal gas is completely 
disordered. The system can be found in any of its accessible states with the same 
probability. All of them contribute in equal measure to the "information" stored in 
the ideal gas. It has therefore a maximum "information". These two simple systems 
are extrema in the scale of "order" and "information". It follows that the definition 
of "complexity" must not be made in terms of just "order" or "information". 

It might seem reasonable to propose a measure of "complexity" by adopting 
some kind of distance from the equiprobable distribution of the accessible states of 
the system. Defined in this way, "disequilibrium" would give an idea of the prob- 
abilistic hierarchy of the system. "Disequilibrium" would be different from zero if 
there are privileged, or more probable, states among those accessible. But this would 
not work. Going back to the two examples we began with, it is readily seen that a 
perfect crystal is far from an equidistribution among the accessible states because 
one of them is totally prevailing, and so "disequilibrium" would be maximum. For 
the ideal gas, "disequilibrium" would be zero by construction. Therefore such a dis- 
tance or "disequilibrium" (a measure of a probabilistic hierarchy) cannot be directly 
associated with "complexity". 

In Figure fTTI we sketch an intuitive qualitative behavior for "information" H and 
"disequilibrium" D for systems ranging from the perfect crystal to the ideal gas. This 
graph suggests that the product of these two quantities could be used as a measure 
of "complexity": C = H D. The function C has indeed the features and asyntotical 
properties that one would expect intuitively: it vanishes for the perfect crystal and 
for the isolated ideal gas, and it is different from zero for the rest of the systems 
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of particles. We will follow these guidelines to establish a quantitative measure of 
"complexity". 

Before attempting any further progress, however, we must recall that "complex- 
ity" cannot be measured univocally, because it depends on the nature of the descrip- 
tion (which always involves a reductionist process) and on the scale of observation. 
Let us take an example to illustrate this point. A computer chip can look very differ- 
ent at different scales. It is an entangled array of electronic elements at microscopic 
scale but only an ordered set of pins attached to a black box at a macroscopic scale. 




Fig. 1.1 Sketch of the intuitive notion of the magnitudes of "information" (H) and "disequilibrium" 
(D) for the physical systems and the behavior intuitively required for the magnitude "complexity". 
The quantity C = H ■ D is proposed to measure such a magnitude. 



We shall now discuss a measure of "complexity" based on the statistical descrip- 
tion of systems. Let us assume that the system has N accessible states {x\,xi, ...,xn} 
when observed at a given scale. We will call this an A^-system. Our understanding of 
the behavior of this system determines the corresponding probabilities {pi,P2, • ■•,/>#} 
(with the condition Y!i=\ Pi = 1) of each state (pi > for all i). Then the knowledge 
of the underlying physical laws at this scale is incorporated into a probability dis- 
tribution for the accessible states. It is possible to find a quantity measuring the 
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amount of "information". Under to the most elementary conditions of consistency, 
Shannon B determined the unique function H(p\,p2, ■■■,Pn) that accounts for the 
"information" stored in a system: 

N 

ff = iog/>;, (i.i) 

where K is a positive constant. The quantity H is called information. The redefini- 
tion of information H as some type of monotone function of the Shannon entropy 
can be also useful in many contexts as we shall show in the next sections. In the 
case of a crystal, a state x c would be the most probable p c ~ 1, and all others Xj 
would be very improbable, pt ~ i : ^ c. Then H c ~ 0. On the other side, equiprob- 
ability characterizes an isolated ideal gas, p, ~ 1 /N so H g ~ KlogN, i.e., the max- 
imum of information for a N-system. (Notice that if one assumes equiprobability 
and K = k = Boltzmann constant, H is identified with the thermodinamic entropy, 
S = KlogN). Any other N-system will have an amount of information between those 
two extrema. 

Let us propose a definition of disequilibrium D in a A^-system Q. The intuitive 
notion suggests that some kind of distance from an equiprobable distribution should 
be adopted. Two requirements are imposed on the magnitude of D: D > in order to 
have a positive measure of "complexity" and D = on the limit of equiprobability. 
The straightforward solution is to add the quadratic distances of each state to the 
equiprobability as follows: 

N / ,\2 

D= • (L2) 

According to this definition, a crystal has maximum disequilibrium (for the dom- 
inant state, p c 1, and D c 1 for N — s- °°) while the disequilibrium for an ideal 
gas vanishes (D g ~ 0) by construction. For any other system D will have a value 
between these two extrema. 

We now introduce the definition of complexity C of a A^-system J6] |7). This is 
simply the interplay between the information stored in the system and its disequi- 
librium: 

C = HD = - ^f^logPiV (£(a-^) J. (1-3) 

This definition fits the intuitive arguments. For a crystal, disequilibrium is large but 
the information stored is vanishingly small, so C ~ 0. On the other hand, H is large 
for an ideal gas, but D is small, so C ~ as well. Any other system will have an 
intermediate behavior and therefore C > 0. 

As was intuitively suggested, the definition of complexity ( 11.31 l also depends on 
the scale. At each scale of observation a new set of accessible states appears with its 
corresponding probability distribution so that complexity changes. Physical laws at 
each level of observation allow us to infer the probability distribution of the new set 
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of accessible states, and therefore different values for H, D and C will be obtained. 
The straightforward passage to the case of a continuum number of states, x, can be 
easily inferred. Thus we must treat with probability distributions with a continuum 
support, p(x), and normalization condition f^™ p(x)dx = 1. Disequilibrium has the 
limit D = f^™ p 2 (x)dx and the complexity could be defined by: 

C = H D = -(k J + p(x)logp(x)dxj ■ (j + p 2 {x)dx^j . (1.4) 

As we shall see, other possibilities for the continuous extension of C are also possi- 
ble. 



N = 3 



mmenv 



0.2 



0.4 



v 1 



0.6 



0.8 



H 

Fig. 1.2 In general, dependence of complexity (C) on normalized information (H) is not univocal: 
many distributions {p,} can present the same value of H but different C. This is shown in the case 
N = 3. 



Direct simulations of the definition give the values of C for general A-systems. 
The set of all the possible distributions {p\,p2, • where an A^-system could be 

found is sampled. For the sake of simplicity H is normalized to the interval [0,1]. 
Thus H = L^i/'i'log/'i/log^V '. For each distribution {/?,} the normalized informa- 
tion H({pi}), and the disequilibrium £)({/?,}) (eq. |1.2t are calculated. In each case 
the normalized complexity C = H ■ D is obtained and the pair (H,C) stored. These 
two magnitudes are plotted on a diagram (H, C(H) ) in order to verify the qualitative 
behavior predicted in Figure 11.11 For N = 2 an analytical expression for the curve 
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C(H) is obtained. If the probability of one state is p\ = x, that of the second one is 
simply /?2 = 1 — x. The complexity of the system will be: 

C(x)=H(x)-D(x) = -^[xlog(-^+log(l-x))-2(x-^j . (1.5) 

Complexity vanishes for the two simplest 2-systems: the crystal (H = 0; p\ = 1, 
P2 = 0) and the ideal gas (H = 1; p\ = 1 /2, p2 = 1 /2). Let us notice that this curve 
is the simplest one that fulfills all the conditions discussed in the introduction. The 
largest complexity is reached for H ~ 1/2 and its value is: C(x ~ 0.11) ~ 0.151. 
For N > 2 the relationship between H and C is not univocal anymore. Many differ- 
ent distributions {/?,} store the same information H but have different complexity 
C. Figure [L2l displays such a behavior for N = 3. If we take the maximum com- 
plexity C max {H) associated with each H a curve similar to the one for a 2-system is 
recovered. Every 3-system will have a complexity below this line and upper the line 
°f C m i n (H) and also upper the minimum envelope complexity C m i nen v These lines 
will be analytically found in a next section. In Figure [T31 curves C max (H) for the 
cases = 3, . . . , 10 are also shown. Let us observe the shift of the complexity-curve 
peak to smaller values of entropy for rising N. This fact agrees with the intuition 
telling us that the biggest complexity (number of possibilities of 'complexification') 
be reached for lesser entropies for the systems with bigger number of states. 
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Let us return to the point at which we started this discussion. Any notion of 
complexity in physics 12 [3) should only be made on the basis of a well defined or 
operational magnitude |6|[7). But two additional requirements are needed in order 
to obtain a good definition of complexity in physics: (1) the new magnitude must be 
measurable in many different physical systems and (2) a comparative relationship 
and a physical interpretation between any two measurements should be possible. 

Many different definitions of complexity have been proposed to date, mainly 
in the realm of physical and computational sciences. Among these, several can be 
cited: algorithmic complexity (Kolmogorov-Chaitin) J8][9]], the Lempel-Ziv com- 
plexity iflOl . the logical depth of Bennett ifTTl . the effective measure complexity of 
Grassberger lfl2l . the complexity of a system based in its diversity |[T3l . the thermo- 
dynamical depth lfT4l . the e-machine complexity lfl"5l , the physical complexity of 
genomes lfl6l . complexities of formal grammars, etc. The definition of complexity 
( 11.31 ) proposed in this section offers a new point of view, based on a statistical de- 
scription of systems at a given scale. In this scheme, the knowledge of the physical 
laws governing the dynamic evolution in that scale is used to find its accessible states 
and its probability distribution. This process would immediately indicate the value 
of complexity. In essence this is nothing but an interplay between the information 
stored by the system and the distance from equipartition (measure of a probabilistic 
hierarchy between the observed parts) of the probability distribution of its accessi- 
ble states. Besides giving the main features of a "intuitive" notion of complexity, 
we will show in this chapter that we can go one step further and to compute this 
quantity in other relevant physical situations and in continuum systems. The most 
important point is that the new definition successfully enables us to discern situa- 
tions regarded as complex. For example, we show here two of these applications in 
complex systems with some type of discretization: one of them is the study of this 
magnitude in a phase transition in a coupled map lattice 1 17| and the other one is 
its calculation for the time evolution of a discrete gas out of equilibrium IT8l . Other 
applications to more realistic systems can also be found in the literature 1191 . 



1.1.1 Complexity in a phase transition: coupled map lattices 

If by complexity it is to be understood that property present in all systems attached 
under the epigraph of 'complex systems', this property should be reasonably quanti- 
fied by the measures proposed in the different branches of knowledge. As discussed 
above, this kind of indicators is found in those fields where the concept of informa- 
tion is crucial, from physics lfT2l[l4l to computational sciences ll8l l9l [Tol IT31 . 

In particular, taking into account the statistical properties of a system, the indi- 
cator called the LMC (LopezRuiz-Mancini-Calbet) complexity has been introduced 
J6] I3 in the former section. This magnitude identifies the entropy or information H 
stored in a system and its disequilibrium D, i.e. the distance from its actual state to 
the probability distribution of equilibrium, as the two basic ingredients for calcu- 
lating its complexity. Hence, the LMC complexity C is given by the formula dl.3l ). 
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C(p) = H(p) ■ D(p), where p = {/?,}, with > and i = 1, - ■ ■ ,N, represents the 
distribution of the N accessible states to the system, and A: is a constant taken as 
1/logN. 

As well as the Euclidean distance D is present in the original LMC complexity, 
other kinds of disequilibrium measures have been proposed in order to remedy some 
statistical characteristics considered troublesome for some authors 1201 . In particu- 
lar, some attention has been focused |21 22| on the Jensen-Shannon divergence Djs 
as a measure for evaluating the distance between two different distributions (p\,p2). 
This distance reads: 



with K\ , 7Z2 the weights of the two probability distributions (pi , p%) verifying n\ , 7T2 > 
and %\ + Tto = 1 . The ensuing statistical complexity 



becomes intensive and also keeps the property of distinguishing among distinct de- 
grees of periodicity l23l . In this section, we consider p2 the equiprobability distri- 
bution and K\=K2 = 0.5. 

As it can be straightforwardly seen, all these LMC-like complexities vanish both 
for completely ordered and for completely random systems as it is required for the 
correct asymptotic properties of a such well-behaved measure. Recently, they have 
been successfully used to discern situations regarded as complex in discrete systems 
out of equilibrium fT8ll24ll25ll26ll27ll28ll29ll30l. 

Here, the local transition to chaos via intermittency 0311 in the logistic map, 
x n +\ = Xx n {\ —x n ) presents a sharp transition when C is plotted versus the param- 
eter X in the region around the instability for A ~ X t = 3.8284. When X < X t the 
system approaches the laminar regime and the bursts become more unpredictable. 
The complexity increases. When the point X = Xt is reached a drop to zero occurs 
for the magnitude C. The system is now periodic and it has lost its complexity. The 
dynamical behavior of the system is finally well reflected in the magnitude C as it 
has been studied in Q). 

When a one-dimensional array of such maps is put together a more complex 
behavior can be obtained depending on the coupling among the units. Ergo the phe- 
nomenon called spatio-temporal intermittency can emerge 11321 [33l [341 . This dy- 
namical regime corresponds with a situation where each unit is weakly oscillating 
around a laminar state that is aperiodically and strongly perturbed for a traveling 
burst. In this case, the plot of the one-dimensional lattice evolving in time gives rise 
to complex patterns on the plane. If the coupling among units is modified the sys- 
tem can settle down in an absorbing phase where its dynamics is trivial I35ll36ll and 
then homogeneous patterns are obtained. Therefore an abrupt transition to spatio- 
temporal intermittency can be depicted by the system l37l [38l when modifying the 
coupling parameter. 

Now we are concerned with measuring C and Cj$ in a such transition for a cou- 
pled map lattice of logistic type. Our system will be a line of sites, i = 1 , . . . , L, with 



Djs{puP2) = H(mp i + K2P2) - n\H(pi) - 7t 2 H(p 2 ) , 



(1.6) 



Cjs — H ■ D JS 



(1.7) 
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periodic boundary conditions. In each site i a local variable x" evolves in time («) 
according to a discrete logistic equation. The interaction with the nearest neighbors 
takes place via a multiplicative coupling: 



= (4-3/>XfK(l-^), 



(1.8) 



where p is the parameter of the system measuring the strength of the coupling (0 < 
p < 1). The variable X" is the digitalized local mean field, 



X" = nint 



( x "i+\ + ■*?-!; 



(1-9) 



with nint(.) the integer function rounding its argument to the nearest integer. Hence 
X" =0or 1. 



2.5 




Fig. 1.4 j8 versus p. The j8 -statistics (or BW density) for each p is the rate between the number 
of black and white cells depicted by the system in the two-dimensional representation of its after- 
transient time evolution. (Computations have been performed with Ap — 0.005 for a lattice of 
10000 sites after a transient of 5000 iterations and a running of other 2000 iterations). 



There is a biological motivation behind this kind of systems ||39l l40l . It could 
represent a colony of interacting competitive individuals. They evolve randomly 
when they are independent (p = 0). If some competitive interaction (p > 0) among 
them takes place the local dynamics loses its erratic component and becomes chaotic 
or periodic in time depending on how populated the vicinity is. Hence, for bigger 
X" more populated is the neighborhood of the individual i and more constrained is 
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its free action. At a first sight, it would seem that some particular values of p could 
stabilize the system. In fact, this is the case. Let us choose a number of individuals 
for the colony (L = 500 for instance), let us initialize it randomly in the range < 
Xi < 1 and let it evolve until the asymptotic regime is attained. Then the black/white 
statistics of the system is performed. That is, the state of the variable xi is compared 
with the critical level 0.5 for i = 1,...,L: if x< > 0.5 the site i is considered white 
(high density cell) and a counter N w is increased by one, or if x, < 0.5 the site i 
is considered black (low density cell) and a counter Nj, is increased by one. This 
process is executed in the stationary regime for a set of iterations. The black/white 
statistics is then the rate j3 = N/,/N w . If j5 is plotted versus the coupling parameter p 
the Figure [T~4l is obtained. 



p=0.200 p=0.256 




Fig. 1.5 Digitalized plot of the one-dimensional coupled map lattice (axe OX) evolving in time 
(axe OY) according to Eq. dl.8t : if > 0.5 the (i,n)-cell is put in white color and if x" < 0.5 the 
(;,n)-cell is put in black color. The discrete time n is reset to zero after the transitory. (Lattices of 
300 x 300 sites, i.e., < i < 300 and < n < 300). 

The region 0.258 < p < 0.335 where /3 vanishes is remarkable. As stated above, 
j3 represents the rate between the number of black cells and the number of white 
cells appearing in the two-dimensional digitalized representation of the colony evo- 
lution. A whole white pattern is obtained for this range of p. The phenomenon of 
spatio-temporal intermittency is displayed by the system in the two borders of this 
parameter region (Fig. II. 51 ). Bursts of low density (black color) travel in an irregular 
way through the high density regions (white color). In this case two-dimensional 
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complex patterns are shown by the time evolution of the system (Fig. |1.5b -c). If the 
coupling p is far enough from this region, i.e., p < 0.25 or p > 0.4, the absorbent 
region loses its influence on the global dynamics and less structured and more ran- 
dom patterns than before are obtained (Fig. ll.5b -d). For p = we have no coupling 
of the maps, and each map generates so called fully developed chaos, where the in- 
variant measure is well-known to be symmetric around 0.5. From this we conclude 
that j3 (p = 0) = 1 . Let us observe that this symmetrical behavior of the invariant 
measure is broken for small p, and j3 decreases slightly in the vicinity of p = 0. 

If the LMC complexities are quantified as function of p, our intuition is con- 
firmed. The method proposed in Ref. @ to calculate C is now adapted to the case 
of two-dimensional patterns. First, we let the system evolve until the asymptotic 
regime is attained. This transient is discarded. Then, for each time n, we map the 
whole lattice in a binary sequence: if x" < 0.5 and 1 if jc" > 0.5, for i = 1 , . . . ,L. 
This L-binary string is analyzed by blocks of n bits, where n a can be considered 
the scale of observation. For this scale, there are 2"° possible states but only some of 
them are accessible. These accessible states as well as their probabilities are found 
in the L-binary string. Next, the magnitudes H, D, Djs, C and Cjs are directly calcu- 
lated for this particular time n by applying the formulas ( 11.31 ,( 11.71 ). We repeat this 
process for a set of successive time units (n,n + 1, • • • ,« + m). The mean values of 
H, D, Djs, C and Cjs for these m time units are finally obtained and plotted in Figs. 

OTP 
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Figures [1 .611 .71 show the result for the case of n = 10. Let us observe that the 
highest C and Cjs are reached when the dynamics displays spatio-temporal intermit- 
tency, that is, the most complex patterns are obtained for those values of p that are 
located on the borders of the absorbent region 0.258 < p < 0.335. Thus the plot of 
C and Cjs versus p shows two tight peaks around the values p = 0.256 and p = 0.34 
(Figs. [Oil. 7b . Let us remark that the LMC complexity C can be neglected far from 
the absorbent region. Contrarily to this behavior, the magnitude Cjs also shows high 
peaks in some other sharp transition of j3 located in the region < p < 25, and an 
intriguing correlation with the black/white statistics in the region 0.4 < p < 1. All 
these facts as well as the stability study of the different dynamical regions of system 
( 11.81 ) are not the object of the present writing but they could deserve some attention 
in a further inspection. 

If the detection of complexity in the two-dimensional case requires to identify 
some sharp change when comparing different patterns, those regions in the param- 
eter space where an abrupt transition happens should be explored in order to obtain 
the most complex patterns. Smoothness seems not to be at the origin of complexity. 
As well as a selected few distinct molecules among all the possible are in the basis 
of life fiTll . discreteness and its spiky appearance could indicate the way towards 
complexity. As we show in the next section, the distributions with the highest LMC 
complexity are just those distributions with a spiky-like appearance fT8l . In this line, 
the striking result here exposed confirms the capability of the LMC-like complexi- 
ties for signaling a transition to complex behavior when regarding two-dimensional 
patterns 17711421 . 



1.1.2 Complexity versus time: the tetrahedral gas 

As before explained, several definitions of complexity, in the general sense of the 
term, have been presented in the literature. These can be classified according to 
their calculation procedure into two broad and loosely defined groups. One of these 
groups is based on computational science and consists of all definitions based on 
algorithms or automata to derive the complexity. Examples are the algorithmic com- 
plexity |9|, the logical depth ifTTl and the e-machine complexity lfl5ll . These defini- 
tions have been shown to be very useful in describing symbolic dynamics of chaotic 
maps, but they have the disadvantage of being very difficult to calculate. Another 
broad group consists of those complexities based on the measure of entropy or en- 
tropy rate. Among these, we may cite the effective measure complexity Ifl2ll . the 
thermodynamic depth fl4l . the simple measure for complexity 0251 and the metric 
or K-S entropy rate [43 44]. These definitions have also been very useful in describ- 
ing symbolic dynamics in maps, the simple measure of complexity having been also 
applied to some physical situation such as a non-equilibrium Fermi gas 14511 . They 
suffer the disadvantage of either being very difficult to calculate or having a simple 
relation to the regular entropy. 
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P 

Fig. 1.7 (•) Cjs versus p. The peaks of this modified LMC complexity are also evident just on the 
borders of the absorbent region 0.258 < p < 0.335, where /3 = (x). (Computations have been 
performed with Ap = 0.005 for a lattice of 10000 sites after a transient of 5000 iterations and a 
running of other 2000 iterations). 

Other definition types of complexity have been introduced. These are based on 
quantities that can be calculated directly from the distribution function describing 
the system. One of these is based on "meta-statistics" (46| and the other on the no- 
tion of "disequilibrium" |7|. This latter definition has been referred above as the 
LMC complexity. These definitions, together with the simple measure for complex- 
ity l25l . have the great advantage of allowing easy calculations within the context 
of kinetic theory and of permitting their evaluation in a natural way in terms of 
statistical mechanics. 

As we have shown in the former sections, the disequilibrium-based complex- 
ity is easy to calculate and shows some interesting properties (7), but suffers from 
the main drawback of not being very well behaved as the system size increases, or 
equivalently, as the distribution function becomes continuous. Feldman and Crutch- 
field 1201 tried to solve this problem by defining another equivalent term for dise- 
quilibrium, but ended up with a complexity that was a trivial function of the entropy. 

Whether these definitions of complexity are useful in non-equilibrium thermo- 
dynamics will depend on how they behave as a function of time. There is a general 
belief that, although the second law of thermodynamics requires average entropy 
(or disorder) to increase, this does not in any way forbid local order from arising 
B7l . The clearest example is seen with life, which can continue to exist and grow 
in an isolated system for as long as internal resources last. In other words, in an 
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isolated system the entropy must increase, but it should be possible, under certain 
circumstances, for the complexity to increase. 

Here we examine how LMC complexity evolves with time in an isolated system 
and we show that it indeed has some interesting properties. The disequilibrium- 
based complexity Q defined in equation ( 11.31 ) actually tends to be maximal as the 
entropy increases in a Boltzmann integro-differential equation for a simplified gas. 

We proceed to calculate the distributions which maximize and minimize the com- 
plexity and its asymptotic behavior, and also introduce the basic concepts underlying 
the time evolution of LMC complexity in Sect. 11.1.2.11 Later, in Sects. [P .2.21 and 
11.1.2.31 by means of numerical computations following a restricted version of the 
Boltzmann equation, we apply this to a special system, which we shall term "tetra- 
hedral gas". Finally, in Sect. 11. 1.2.41 the results and conclusions for this system are 
given, together with their possible applications. 

1.1.2.1 Maximum and minimum complexity 

In this section, we assume that the system can be in one of its N possible accessible 
states, ;. The probability of the system being in state i will be given by the discrete 
distribution function, f\ > 0, with the normalization condition / = £j=i fi = L The 
system is defined such that, if isolated, it will reach equilibrium, with all the states 
having equal probability, f e = ^. Since we are supposing that H is normalized, < 
H < 1, and 0<D<(N—l)/N, then complexity, C, is also normalized, < C < 1. 

When an isolated system evolves with time, the complexity cannot have any pos- 
sible value in a C versus H map as it can be seen in Fig. II. 21 ). but it must stay within 
certain bounds, C max and C m ; n . These are the maximum and minimum values of C 
for a given H. Since C = DH, finding the extrema of C for constant H is equivalent 
to finding the extrema of D. 

There are two restrictions on D: the normalization, /, and the fixed value of the 
entropy, H. To find these extrema undetermined Lagrange multipliers are used. Dif- 
ferentiating expressions of D, I and H, we obtain 



dD 



2(/)-/e), 



(1.10) 



dfj 



dl 



1 



(l.H) 



dfj 



dH 



— (ln/, + 1) . 



(1.12) 



dfj 



Defining X\ and %i as the Lagrange multipliers, we get: 



2(fj - / e ) + l x + A 2 (ln/ 7 - + l)/lniV = . 



(1.13) 



Two new parameters, a and j5, which are a linear combinations of the Lagrange 
multipliers are defined: 
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fj + a\nfj + p = 0, (1.14) 

where the solutions of this equation, fj, are the values that minimize or maximize 
the disequilibrium. 

In the maximum complexity case there are two solutions, /,-, to Eq. ( 11.14b which 
are shown in Table ll.ll One of these solutions, / max , is given by 



1 

H = 

In A? 



/max In /max + ( 1 — /max) In 



1 /ma; 

N-l 



(1.15) 



and the other solution by ( 1 — / max )/(N— 1 ) . 

The maximum disequilibrium, Z) max , for a fixed H is 

Omax = (/max ~ fe? + (N - 1) ( - frj , (1.16) 

and thus, the maximum complexity, which depends only on H, is 

C m ax(H)=D max -//. (1.17) 

The behavior of the maximum value of complexity versus InN was computed in 
Ref. RID. 



Table 1.1 Probability values, fj, that give a maximum of disequilibrium, D max . for a given H. 



Number of states 
with fj 


fj 


Range of f j 


1 


fmax 




N— 1 


1 /max 
N-\ 


0...1 



Table 1.2 Probability values, f j, that give a minimum of disequilibrium, £>,„;„, for a given H. 



Number of states 


fj 


Range of /, 


with f j 


n 








1 


/min 




N-n- 1 


1 ~ ./min 


1 1 


N-n- 1 


N-n ••• W-n-1 



n can have the values 0,1, . . . N — 2. 



Equivalently, the values, fj, that give a minimum complexity are shown in Table 
PI One of the solutions, / m i n , is given by 



H = - 



1 

ln>Y 



/min In /min + (1 - /min) In 



1 /min 

iV-n- 1 



(1.18) 
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where n is the number of states with f> = and takes a value in the range n 
0,1, ... ,N-2. 



N 




Fig. 1.8 Maximum, minimum, and minimum envelope complexity, C max » C m ; n , and C m ; n env respec- 
tively, as a function of the entropy, H, for a system with N = 4 accessible states. 



The resulting minimum disequilibrium, D m ; n , for a given H is, 



A™n = (/min-/e) 2 + (jV-n-l) 



1 ,/min 

N-n-l 



/e + "/e 



(1.19) 



Note that in this case fj = is an additional hidden solution that stems from the 
positive restriction in the /, values. To obtain these solutions explicitly we can define 
xt such that f = x, 2 . These xi values do not have the restriction of positivity imposed 
to fi and can take a positive or negative value. If we repeat the Lagrange multiplier 
method with these new variables a new solution arises: xs = 0, or equivalently, fj = 
0. 

The resulting minimum complexity, which again only depends on H, is 

C rain (//)=Anin-H. (1.20) 

As an example, the maximum and minimum of complexity, C max and C m j n , are plot- 
ted as a function of the entropy, H, in Fig. ll.8l for N = A. Also, in this figure, it is 
shown the minimum envelope complexity, C m i nen v = ^minenv ■ H, where Aninenv is 
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defined below. In Fig. 11.91 the maximum and minimum disequilibrium, Z) max and 
D min. versus H are also shown. 




As shown in Fig. |1.9| the minimum disequilibrium function is piecewise defined, 
having several points where its derivative is discontinuous. Each of these function 
pieces corresponds to a different value of n (Table II. 21 ). In some circumstances it 
might be helpful to work with the "envelope" of the minimum disequilibrium func- 
tion. The function, D m i nenv , that traverses all the discontinuous derivative points in 
the D m i n versus H plot is 

r> — —H\nN _ / 1 

^minenv — " ^ i K^-^-^f 

and is also shown in Figure [L9l 

When N tends toward infinity the probability, f max , of the dominant state has a 
linear dependence with the entropy, 

lim/ max = l-H, (1.22) 

and thus the maximum disequilibrium scales as lim;v^oo £> m ax = ( 1 — H) 2 . The max- 
imum complexity tends to 
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limC max =//(l-//) 2 . (1.23) 

The limit of the minimum disequilibrium and complexity vanishes, lim^^oo £> m inenv = 
0, and thus 

limC min = 0. (1.24) 

In general, in the limit N —> °°, the complexity is not a trivial function of the entropy, 
in the sense that for a given H there exists a range of complexities between and 
Cmax, gi yen by Eqs. d 1 . 24t and dl.23t , respectively. 

In particular, in this asymptotic limit, the maximum of C max is found when 
H = 1/3, or equivalently / max = 2/3, which gives a maximum of the maximum 
complexity of C max =4/27. This value was numerically calculated in Ref. l48l . 



1.1.2.2 An out equilibrium system: the tetrahedral gas 

We present a simplified example of an ideal gas: the tetrahedral gas. This system is 
generated by a simplification of the Boltzmann integro-differential equation of an 
ideal gas. We are interested in studying the disequilibrium time evolution. 



1 




Fig. 1.10 The four possible directions of the velocities of the tetrahedral gas in space. Positive 
senses are defined as emerging from the center point and with integer numbers 1,2,3,4. 

The Boltzmann integro-differential equation of an ideal gas with no external 
forces and no spatial gradients is 

J d 3 ^J ^ c . m .a(v,-v^v:-v')|v,-v| [f(v>,;t)f(v>;t)-f(v*;t)f(v,t)} , 

(1.25) 
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where a represents the cross section of a collision between two particles with initial 
velocities v and v* and after the collision with velocities v' and v^; and £2 c . m . are all 
the possible dispersion angles of the collision as seen from its center of mass. 

In the tetrahedral gas, the particles can travel only in four directions in three- 
dimensional space and all have the same absolute velocity. These directions are the 
ones given by joining the center of a tetrahedron with its corners. The directions 
can be easily viewed by recalling the directions given by a methane molecule, or 
equivalently, by a caltrop, which is a device with four metal points so arranged that 
when any three are on the ground the fourth projects upward as a hazard to the 
hooves of horses or to pneumatic tires (see Fig. ll.10t . 

By definition, the angle that one direction forms with any other is the same. It 
can be shown that the angles between different directions, a, satisfy the relationship 
cos a = —1/3, which gives a = 109.47°. The plane formed by any two directions 
is perpendicular to the plane formed by the remaining two directions. 

We assume that the cross-section, a, is different from zero only when the angle 
between the velocities of the colliding particles is 109.47°. It is also assumed that 
this collision makes the two particles leave in the remaining two directions, thus 
again forming an angle of 109.47°. A consequence of these restrictions is that the 
modulus of the velocity is always the same no matter how many collisions a parti- 
cle has undergone and they always stay within the directions of the vertices of the 
tetrahedron. Furthermore, this type of gas does not break any law of physics and is 
perfectly valid, although hypothetical. 

We label the four directions originating from the center of the caltrop with num- 
bers, 1,2,3,4 (see Fig. 1 1 . 10b . The velocity components with the same direction but 
opposite sense, or equivalently, directed toward the center of the caltrop, are labeled 
with negative numbers —1, —2, —3, —4. 

In order to formulate the Boltzmann equation for the tetrahedral gas, and because 
all directions are equivalent, we need only study the different collisions that a par- 
ticle with one fixed direction can undergo. In particular if we take a particle with 
direction — 1 the result of the collision with another particle with direction —2 are 
the same two particles traveling in directions 3 and 4, that is, 

(-1,-2) -> (3,4). (1.26) 

With this in mind the last bracket of Eq. (11.25b is, 

hU-f-if-2, (1-27) 

where denotes the probability of finding a particle in direction i. Note that the 
dependence on velocity, v, of the continuous velocity distribution function, /(v;f), 
of Eq. ( I1.25l l is in our case contained in the discrete subindex, i, of the distribution 
function 

We can proceed in the same manner with the other remaining collisions, 



(-1,-3) -> (2,4), 
(-1,-4) ^(2,3). 



(1.28) 
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When a particle with direction —1 collides with a particle with direction 2, they do 
not form an angle of 109.47°; i.e., they do not collide, they just pass by each other. 
This is a consequence of the previous assumption for the tetrahedral gas, which 
establishes a null cross section for angles different from 109.47°. The same can be 
said for collisions (—1,3), (—1,4), and (—1,1). All these results are summarized in 
Table 

Table 1.3 Cross sections, o", for a particle in direction —1 colliding with particles in the other 
remaining directions of the tetrahedral gas. 



Collision 


Cross section 


of particles 


a 


(-1,-2) (3,4) 


1 


(-1,-3) -> (2,4) 


1 


(-1,-4) (2,3) 


1 


Other collisions 






Taking all this into account, Eq. ( 11.25b for direction —1 is reduced to a discrete 
sum, 

^ = (/3/4-/-1/-2) + (/2/4-/-1/-3) + C/a/3 -/-1/-4) , (1.29) 

where all other factors have been set to unity for simplicity. 

The seven remaining equations for the rest of directions can be easily inferred. If 
we now make /, = /_,■(/ = 1,2,3,4) initially, this property is conserved in time. The 
final four equations defining the evolution of the system are: 

C/3/4 - /1/2) + (Ma - /1/3 ) + Cfzfc - /1/4) , 

(/3/4 - /l/2) + (/l/4 - Mi) + (/l/3 - /2/4) , 

(Ma - /3/1 ) + (/i/4 - Mi) + (Mi - Ma) , 

(/ 2 / 3 -/4/1) + (M3-M1) + (Mi- Ma) ■ (1.30) 

Note that the ideal gas has been reduced to the tetrahedral gas, which is a four- 
dimensional dynamical system. The velocity distribution function, fi, corresponds 
to a probability distribution function with N = 4 accessible states that evolve in time. 

1.1.2.3 Evolution of the tetrahedral gas with time 

To study the time evolution of the complexity, a diagram of C versus time, t , can be 
used. But, as we know, the second law of thermodynamics states that the entropy 



d_h 

dt 
dh 

dt 
dh 

dt 
d_U 

dt 
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grows monotonically with time, that is, 

f>0. (1.31) 
at 

This implies that an equivalent way to study the time evolution of the complexity 
can be obtained by plotting C versus H. In this way, the entropy substitutes the time 
axis, since the former increases monotonically with the latter. The conversion from 
C vs. H to C vs. t diagrams is achieved by stretching or shrinking the entropy axis 
according to its time evolution. This method is a key point in all this discussion. 
Note that, in any case, the relationship of H versus t will, in general, not be a simple 
one ||49l . 

The tetrahedral gas, Eqs. ( 11.301 1, reaches equilibrium when fi = \ /N for i = 
1,2,3,4 and N = 4. This stationary state, dfi/dt = 0, represents the equiprobability 
towards which the system evolves in time. This is consistent with the definition of 
disequilibrium in which we assumed that equilibrium was reached at equiprobabil- 
ity, fi= f e , where D = 0. 



(f 1 ,f 2 ,f 3 ,f 4 )(t=0)=(0.8,0.2,0.0,0.0) (f 1 ,f 2 ,f 3 ,f 4 )(t=0)=(0.5,0.5,0.0,0.0) 




Fig. 1.11 Time evolution of the system in (H.D) phase space for two different initial conditions 
at time t = 0: (a) (JuhJsJi) = (0.8,0.2,0,0) and (b) C/1,/2,/3,/4) = (0.5,0.5,0,0). The maxi- 
mum and minimum disequilibrium are shown by dashed lines. 



As the isolated system evolves it gets closer and closer to equilibrium. In this 
sense, one may intuitively think that the disequilibrium will decrease with time. In 
fact, it can be analytically shown lTT8ll that, as the system approaches to equilibrium, 
D tends to zero monotonically with time: 

dD 

— <0. (1.32) 
at 



There are even more restrictions on the evolution of this system. It would be ex- 
pected that the system approaches equilibrium, D = 0, by following the most direct 
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path. To verify this, numerical simulations for several initial conditions have been 
undertaken. In all of these we observe the additional restriction that D approaches 
D max on its way to D = 0. In fact it appears as an exponential decay of D towards 
D max in a D versus H plot. As an example, two of these are shown in Fig. 11.111 
where Fig. ll.lll" a) shows a really strong tendency towards D max . Contrary to intu- 
ition, among all the possible paths that the system can follow toward equilibrium, it 
chooses those closest to D max in particular. 



(f 1 ,f 2 ,f 3 ,f 4 )(t=0)=(0.8,0.2,0.0,0.0) (f,,f 8 ,f3,f 4 )(t=0)=(0.5,0.5,0.0,0.0) 




Fig. 1.12 Time evolution of the system in (H,C) phase space for two different initial conditions 
attimef = 0: (a) (fufa&fi) = (0.8,0.2,0,0) and (b) (f u faft,fy) = (0.5,0.5,0,0). The maxi- 
mum and minimum complexity are shown by dashed lines. 

We can also observe this effect in a complexity, C, versus H plot. This is shown 
for the same two initial conditions in Figure [TTT21 

This additional restriction to the evolution of the system is better viewed by plot- 
ting the difference C max — C versus H. In all the cases analyzed (see two of them in 
Fig. ll . 13t the following condition is observed: 

d(C max -C) ^ Q ( 
dt 

This has been verified numerically and is illustrated in Figure [TT4l where this time 
derivative, which always remains negative, is shown as a function of H for a grid of 
uniformly spaced distribution functions, (f\ ,/2,/3,/4), satisfying the normalization 
condition /. Two system trajectories are also shown for illustrative purposes. The 
numerical method used to plot this function is explained in ||T8l . 

We proceed now to show another interesting property of this system. As shown 
in Table 1 1 . ll a collection of maximum complexity distributions for N = 4 can take 
the form 

f\ = /max ? 



1.1 A Statistical Measure of Complexity. Some Applications 
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Fig. 1.13 Time evolution of the system in (H, C ma x — C) phase space for two different initial con- 
ditions at time f = 0: (a) C/1,/2,/3,/4) = (0.8,0.2,0,0) and (b) {fufi,fo,U) = (0.5,0.5,0,0). The 
values C ra ax — C m in are shown by dashed lines. 



„ 1 /max . ~ „ . 
fi = 5 ,2 = 2,3,4, 



(1.34) 



where / max runs from l/N (equiprobability distribution) to 1 ("crystal" distribution). 
The complexity of this collection of distributions covers all possible values of C max . 

There is actually a time evolution of the tetrahedral gas, or trajectory of the sys- 
tem, formed by this collection of distributions. Inserting Eqs. ( 11.34b in the evolution 
Eqs. (11.301 , it is found that all equations are compatible with each other and the 
dynamical equations are reduced to the relation, 



dfn- 



dt 



-(4/, 
3 V Jt 



max 



-5/ max + l). 



(1.35) 



This trajectory is denoted as the maximum complexity path. 

Note that the equiprobability or equilibrium, / raax = 1 /4, is a stable fixed point 
and the maximum disequilibrium "crystal" distribution, / max = 1, is an unstable 
fixed point. Thus the maximum complexity path is a heteroclinic connection be- 
tween the "crystal" and equiprobability distributions. 

The maximum complexity path is locally attractive. Let us assume, for instance, 
the following perturbed trajectory 

,f\ = /max , 

1 /max 



h 
h 
h 



3 

1 /max 

3 

1 /max 



-5, 



(1.36) 
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Fig. 1.14 Numerical verification of d(C mm — C) /dt < 0. This time derivative is shown as a function 
of H. A grid of uniformly spaced, Afi = 0.5, distribution functions, (fl,f2,f3,fl), satisfying the 
normalization condition /, have been used. Two system trajectories for initial conditions, t = 0, 
(/i,/2,/3,/4) = (0.8,0.2,0,0) and (/i,/ 2 ,/ 3 ,/ 4 ) = (0.5,0.5,0,0) are also shown for illustrative 
purposes. It can be seen how the above-mentioned time derivative always remains negative. 



whose evolution according to Eqs. ( 11.30b gives the exponential decay of the pertur- 
bation, 8: 

dt 



8. 



(1.37) 



showing the attractive nature of these trajectories. 



1.1.2.4 Conclusions and further remarks 



In the former section, the time evolution of the LMC complexity, C, has been studied 
for a simplified model of an isolated ideal gas: the tetrahedral gas. In general, the 
dynamical behavior of this quantity is bounded between two extremum curves, C max 
and C m i n , when observed in a C versus H phase space. These complexity bounds 
have been derived and computed. A continuation of this work applied to the study 
of complexity in gases out of equilibrium can be found in Refs. l50ll5T1 . 

For the isolated tetrahedral gas two constraints on its dynamics are found. The 
first, which is analytically demonstrated, is that the disequilibrium, D, decreases 
monotonically with time until it reaches the value D = for the equilibrium state. 
The second is that the maximum complexity paths, C max , are attractive in phase 
space. In other words, the complexity of the system tends to equilibrium always ap- 
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Fig. 1.15 The time evolution of the system for three different initial conditions, t = 0, 
(/i./2,/3,/4) = (0.8,0.2,0,0), (/i,/2,/3,/4) = (0.5, 0.5, 0,0), and the maximum complexity path 
are shown. The minimum complexity is shown by dashed lines. It can be seen how the system 
tends to approach the maximum complexity path as it evolves in time toward equilibrium. 

proaching those paths. This has been verified numerically, that is, the time derivative 
of the difference between C max and C is negative. Fi g . 1 1 . 1 5 1 summarizes the dynam- 
ical behavior of the tetrahedral gas. The different trajectories starting with arbitrary 
initial conditions, which represent systems out of equilibrium, evolve towards equi- 
librium approaching the maximum complexity path. 

Whether these properties are useful in real physical systems can need of a fur- 
ther inspection, particularly the macroscopical nature of the disequilibrium in more 
general systems, such as to the ideal gas following the complete Boltzmann integro- 
differential equation. Another feature that could deserve attention is the possibility 
of approximating the evolution of a real physical system trajectory to its maximum 
complexity path. Note that in general, for a real system, the calculation of the max- 
imum complexity path will not be an easy task. 



1.2 The Statistical Complexity in the Continuous Case 

As explained in the former sections, the LMC statistical measure of complexity Q 
identifies the entropy or information stored in a system and its distance to the equi- 
librium probability distribution, the disequilibrium, as the two ingredients giving the 
correct asymptotic properties of a well-behaved measure of complexity. In fact, it 
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vanishes both for completely ordered and for completely random systems. Besides 
giving the main features of an intuitive notion of complexity, it has been shown that 
LMC complexity successfully enables us to discern situations regarded as complex 
in discrete systems out of equilibrium: one instance of phase transitions via inter- 
mittency in coupled logistic maps ifTTl or via stochastic synchronization in cellular 
automata ll42l . the dynamical behavior of this quantity in a out-equilibrium gases 
lfT8ll50ll5Tl and other applications in classical statistical mechanics ll30ll52l . 

A possible formula of LMC complexity for continuous systems was suggested 
in formula ( 11.4b . Anteneodo and Plastino l48l pointed out some peculiarities con- 
cerning such an extension for continuous probability distributions. It is the aim of 
this section to offer a discussion of the extension of LMC complexity for contin- 
uous systems and to present a slightly modified extension |53ll of expression dl.4| > 
that displays interesting and very striking properties. A further generalization of this 
work has been done in Ref . Il54l l55l . 

In Sect. 11.2. li the extension of information and disequilibrium concepts for the 
continuous case are discussed. In Sect. 11.2.21 the LMC measure of complexity is 
rewieved and possible extensions for continuous systems are suggested. We proceed 
to present some properties of one of these extensions in Sect. 11.2.31 



1.2.1 Entropy/information and disequilibrium 

Depending on the necessary conditions to fulfill, the extension of an established 
formula from the discrete to the continuous case always requires a careful study and 
in many situations some kind of choice between several possibilities. Next we carry 
out this process for the entropy and disequilibrium formulas. 

1.2.1.1 Entropy or information 

As we know, given a discrete probability distribution {/?,},=i.2 n satisfying pi > 



and Yfi=\Pi = 1> tne Boltzmann-Gibss-Shannon formula [4| that accounts for the 
entropy or information, S, stored in a system is defined by 



where k is a positive constant. If we identify H with S, then some properties of 
this quantity are: (i) positivity: H > for any arbitrary set {/?,}, (ii) concavity: H 
is concave for arbitrary {pj} and reaches the extremal value for equiprobability 
(Pi = 1 /N V;'), (iii) additivity: H(A U B) = H(A) + H(B) where A and B are two 
independent systems, and (iv) continuity: H is continuous for each of its arguments. 
And vice versa, it has been shown that the only function of {/?,} verifying the latter 
properties is given by Eq. (11.38b J4][56). For an isolated system, the irreversibility 



N 



S[{pi}) = -k^ t pilog Pi 



(1.38) 



<■=] 
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property is also verified, that is, the time derivative of H is positive, dH/dt > 0, 
reaching the equality only for equilibrium. 

Calculation of H for a continuous probability distribution p(x), with support on 
[— L,L] and J^ L p(x)dx = 1, can be performed by dividing the interval [— L,L] in 
small equal-length pieces Ax = Xj — jc,-_i, i = 1, ■ • • ,n, with xq — —L and x„ = L, 
and by considering the approximated discrete distribution {/?,} = {p(xi)Ax}, i = 
1 , • • • , n, with xi a point in the segment [x,_ i , x,] . It gives us 

H*=H({ Pi })= (1.39) 

n n 

= -kY,p{xi)logp(xi)Ax - k' s £ J p{xi)\og(Ax)Ax. 

i=i i=i 

The second adding term of H* in the expression (|1.39t grows as log n when n goes 
to infinity. Therefore it seems reasonable to take just the first and finite adding term 
of H* as the extension of H to the continuous case: H(p(x)). It characterizes with 
a finite number the information contained in a continuous distribution p(x). In the 
limit n — > °°, we obtain 

n 



-kJ^p(xj)logp(xi)Aj 

i=i 

L 



H{p{xj) = lim 

11— >oa 

= -k J L p(x)logp(x)dx. (1.40) 



If p(x) > 1 in some region, the entropy defined by Eq. ( 1 1 .401 ) can become negative. 
Although this situation is mathematically possible and coherent, it is unfounded 
from a physical point of view. See ||57l for a discussion on this point. Let f(p,q) 
be a probability distribution in phase space with coordinates (p,q), /> and dpdq 
having the dimension of an action. In this case the volume element is dpdq/h with 
h the Planck constant. Suppose that H(f) < 0. Because of J (dpdq/h) f = 1, the 
extent of the region where / > 1 must be smaller than h. Hence a negative classical 
entropy arises if one tries to localize a particle in phase space in a region smaller than 
h, that is, if the uncertainty relation is violated. In consequence, not every classical 
probability distribution can be observed in nature. The condition H(f) = could 
give us the mininal width that is physically allowed for the distribution and so the 
maximal localization of the system under study. This cutting property has been used 
in the calculations performed in 



1.2.1.2 Disequilibrium 

Given a discrete probability distribution {p,} i= i.2 n satisfying pi > and Yd=i Pi = 

1, its Disequilibrium, D, can be defined as the quadratic distance of the actual prob- 
ability distribution {/?,-} to equiprobability: 
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N / i \2 
£({/><}) = £ \ Pi - jj) ■ (1.41) 

D is maximal for fully regular systems and vanishes for completely random ones. 

In the continuous case with support on the interval [—L,L], the rectangular func- 
tion p(x) = 1/ (2L), with — L < x < L, is the natural extension of the equiprobability 
distribution of the discrete case. The disequilibrium could be defined as 




(1.42) 



If we redefine D omitting the constant adding term in D*, the disequilibrium reads 
now: 

rL 

D(p(x)) = J p 2 {x)dx. (1.43) 

D > for every distribution and it is minimal for the rectangular function which 
represents the equipartition. D does also tend to infinity when the width of p(x) 
narrows strongly and becomes extremely peaked. 



1.2.2 The continuous version C of the LMC complexity 

As shown in the previous sections, LMC complexity has been successfully calcu- 
lated in different systems out of equilibrium. However, Feldman and Cruchtfield 
11201 presented as a main drawback that C vanishes and it is not an extensive vari- 
able for finite-memory regular Markov chains when the system size increases. This 
is not the general behavior of C in the thermodynamic limit as it has been suggested 
by Calbet and Lopez-Ruiz lfl8l . On the one hand, when N — > °° and k = \/\ogN, 
LMC complexity is not a trivial function of the entropy, in the sense that for a given 
H there exists a range of complexities between and C max {H), where C, mx is given 
by expression dl.23l ). 

Observe that in this case H is normalized, < H < 1, because k = 1/logAf. 
On the other hand, non-extensitivity cannot be considered as an obstacle since it is 
nowadays well known that there exists a variety of physical systems for which the 
classical statistical mechanics seems to be inadequate and for which an alternative 
non-extensive thermodynamics is being hailed as a possible basis of a theoretical 
framework appropriate to deal with them 1581 . 

According to the discussion in Section 11.2.11 the expression of C for the case 
of a continuum number of states, x, with support on the interval [— L,L] and 
J^ L p(x)dx= 1 , is defined by 

C(p(x))=H(p(x))-D(p(x)) = 

-k ( p{x)\ogp(x)dx) ■ ( ( p 2 {x)dx\ . (1.44) 



-L I \J-L 
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Hence, C can become negative. Obviously, C < implies H < 0. Although this sit- 
uation is coherent from a mathematical point of view, it is not physically possible. 
Hence a negative entropy means to localize a system in phase space into a region 
smaller than h (Planck constant) and this would imply to violate the uncertainty 
principle (see discussion of Section [T.2.1.U . Then a distribution can broaden with- 
out any limit but it cannot become extremely peaked. The condition H = could 
indicate the minimal width that p(x) is allowed to have. Similarly to the discrete 
case, C is positive for any situation and vanishes both for an extreme localization 
and for the most widely derealization embodied by the equiprobability distribu- 
tion. Thus, LMC complexity can be straightforwardly calculated for any continuous 
distribution by Eq. ( 11.44b . Anyway, the positivity of C for every distribution in the 
continuous case can be recovered by taking the exponential of S [5911 and redefining 
H according to this exponential, i.e. H = e s . To maintain the same nomenclature 
than in the precedent text we continue to identify H with S and we introduce the 
symbol H = e H . Then the new expression of the statistical measure of complexity 
C is identified as C in the rest of this section and is given by |53"1 

C(p(x))=8(p(x))-D(p(x))=e H (rW .D{p(x)) . (1.45) 

In addition to the positivity, C encloses other interesting properties that we describe 
in the next section. 



1.2.3 Properties of C 

The quantity C given by Eq. ( 11.45b has been presented as one of the possible ex- 
tensions of the LMC complexity for continuous systems 1531 . We proceed now to 
present some of the properties that characterize such a complexity indicator. 

1.2.3.1 Invariance under translations and rescaling transformations 

If p(x) is a density function defined on the real axis R, f R p(x)dx = 1, and a > 
and j3 are two real numbers, we denote by p a p(x) the new probability distribution 
obtained by the action of a j3 -translation and an a-rescaling transformation on p(x), 

Pa,p(x) = ap(a(x-P)) . (1.46) 

When a < 1, p a p (x) broadens whereas if a > 1 it becomes more peaked. Observe 
that p a ,p(x) is also a density function. After making the change of variable y = 
a(x — [}) we obtain 



/ PaB( x )dx= / ap(a(x — f}))dx= / p(y)dy = l. (1.47) 

JR JR JR 
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The behaviour of H under the transformation given by Eq. ( 1 1.461 ) is the following: 



H iPa,p) = - Pa i pi x )^Pa i pi x ) dx = ~ / p(y)^g(ap(y))dy 

J R J R 

= - / p{y)\°EP{y)dy~\oga / p(y)dy 
Jr Jr 

= //(/?) -log a. (1.48) 

Then, 

fi(j> a ,f } )=e H ^ = ^-, (1.49) 
It is straightforward to see that D(p a a) = aD(p), and to conclude that 

C(p a ,p)=H{p a ,p)-D(p a ^) = -^-aD(p)=C{p) . (1.50) 

Observe that translations and rescaling transformations keep also the shape of the 
distributions. Then it could be reasonable to denominate the invariant quantity C as 
the shape complexity of the family formed by a distribution p(x) and its transformed 
Pa,pi x )- Hence, for instance, the rectangular II(x), the isosceles-triangle shaped 
A(x), the gaussian -T(x), or the exponential E(x) distributions continue to belong 
to the same fl, A, F or E family, respectively, after applying the transformations 
defined by Eq. ( I1.461 l. Calculation of C on these distribution families gives us 



C(JT) = 


1 




(1.51) 


C(A) = 




v 1.0991 


(1.52) 


c(r) = 




« 1.1658 


(1.53) 


C(S) = 


e 
2 


a 1.3591 . 


(1.54) 



Remark that the family of rectangular distributions has a smaller C than the rest of 
distributions. This fact is true for every distribution and it will be proved in Section 
11.2.3.41 



1.2.3.2 Invariance under replication 

Lloyd and Pagels ifPfll recommend that a complexity measure should remain essen- 
tially unchanged under replication. We show now that C is replicant invariant, that 
is, the shape complexity of m replicas of a given distribution is equal to the shape 
complexity of the original one. 

Suppose p(x) a compactly supported density function, f'^ 00 p(x)dx = 1. Take n 
copies p m (x), m= ,n, of p(x), 
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p m (x) = -^= p(Vn(x - A,,,)) , 1 < m < n, (1.55) 
V" 

where the supports of all the p m (x), centered at X' m s points, m = 1, •••,«, are all 
disjoint. Observe that p m (x) dx = i what make the union 

n 

q(x) = £ Pm(x) (1-56) 
i=l 

to be also a normalized probability distribution, J x ao q(x)dx = 1. For every p m (x), a 
straightforward calculation shows that 

H{p m ) = -H{p) + -\ogyfr (1.57) 
n n 

D(p m ) = -^ r D{p). (1.58) 

Taking into account that the m replicas are supported on disjoint intervals on R, we 
obtain 

H(q) =H{p)+\ogy/Ji, (1.59) 

D(q) = ±=D{p). (1.60) 
V« 

Then, 

C(q)=C(p), (1.61) 
what completes the proof of the replicant invariance of C. 



1.2.3.3 Near-continuity 



Continuity is a desirable property of an indicator of complexity. For a given scale 
of observation, similar systems should have a similar complexity. In the continuous 
case, similarity between density functions defined on a common support suggests 
that they take close values almost everywhere. More strictly speaking, let 8 be a 
positive real number. It will be said that two density functions f(x) and g(x) defined 
on the interval I £R are 8 -neighboring functions on / if the Lebesgue measure of 
the points x E I verifying | f(x) — g(x) \ > 8 is zero. A real map T defined on density 
functions on / will be called near-continuous if for any e > there exists 8(e) > 
such that if f(x) and g(x) are (5 -neighboring functions on / then | T(f) — T(g) \ < E. 

It can be shown that the information H, the disequilibrium D and the shape com- 
plexity C are near-continuous maps on the space of density functions defined on a 
compact support. We must stress at this point the importance of the compactness 
condition of the support in order to have near-continuity. Take, for instance, the 
density function defined on the interval [— 1 ,L], 
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8S,d x ) = 



1-5 if - 1 < x < 
| if <x<L 



(1.62) 



otherwise , 

with < 8 < 1 and L > 1 . If we calculate H and D for this distribution we obtain 

(1.63) 

(1.64) 



H(g^) = -(l-5)log(l-5)-51og( I 



D(g S ,L) = (l-8Y 



Consider also the rectangular density function 

X[-i,o](x) 



1 if — 1 <jc< 
otherwise . 



(1.65) 



If < 8 < 8 < 1, gg^(x) and X[-i.6\i x ) are 5-neighboring functions. When 5^0, 
we have that lim^ogSxM ~ X[-i,o]( x )- ^ n tr, i s limit process the support is main- 
tained and near-continuity manifests itself as following, 



\imC(g SL ) 

5-5-0 



1. 



(1.66) 



But if we allow the support L to become infinitely large, the compactness condi- 
tion is not verified and, although lim^oo g g i(x) and X\-l,o]{ x ) are 5-neighboring 
distributions, we have that 



lim C(g S r 



(1.67) 



Then near-continuity in the map C is lost due to the non-compactness of the support 
when L —> This example suggests that the shape complexity C is near-continuous 
on compact supports and this property will be rigorously proved elsewhere. 



1.2.3.4 The minimal shape complexity 

If we calculate C on the example given by Eq. ( |1.62t , we can verify that the shape 
complexity can be as large as wanted. Take, for instance, 8 = The measure C 
reads now 

Thus C becomes infinitely large after taking the limits L —> or L — >• °o. Remark 
that even in the case gg L has a finite support, C is not upper bounded. The density 
functions, g/$ = i\ (l->o) an< ^ £(8= 1 ) (£-><*•)' °^ i nr * n i te ly increasing complexity have 
two zones with different probabilities. In the case t-)0 there is a narrow zone 
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where probability rises to infinity and in the case L — s- °° there exists an increasingly 
large zone where probability tends to zero. Both kind of density functions show a 
similar pattern to distributions of maximal LMC complexity in the discrete case, 
where there is an state of dominating probability and the rest of states have the same 
probability. 

The minimal C given by Eq. (11.68b is found when L=\, that is, when g$ L 
becomes the rectangular density function X[-\,\\- ^ n f act > tne vame C = 1 is the 
minimum of possible shape complexities and it is reached only on the rectangular 
distributions. We sketch now some steps that prove this result. 

Suppose 

f=£hXE k (1.69) 

k=\ 

to be a density function consisting of several rectangular pieces E k , k= 1 on 
disjoint intervals. If jj, k is the Lebesgue measure of E k , calculation of C gives 

c(/)=n(v A *)-ft A ^V (L70) 

k=i y \k=i ) 

Lagrange multipliers method is used to find the real vector ,jj.2, ■ ■ ■ , jU„; 
Ai, X2, ■ ■ ■ , Xn) that makes extremal the quantity C(f) under the condition YH= 1 AfcjU* = 
1. This is equivalent to studying the extrema of logC(/). We define the function 
z(X k ,fi k ) = logC(/) + a (X£ =1 X k fi k - 1), then 



z{h,Vk) = L jM*logA* + log £ ii k ll + a £ X k /i k - 1 . (1.71) 

k=l \k=l J \k=l J 

Differentiating this expression and making the result equal to zero we obtain 

= _ rtlog ^_ rt + JhB_ + c ^ = (1.72) 



2 

X k logX k + — " k , 7 +ca, = (1.73) 



— - log A k + — — 

dUk I"=iMyA/ 



Dividing Eq. ( 11.721 ) by pi k and Eq. d 1 .73b by X k we get 

2A* 



zuvjx] 
x k 



E"=i MyA? 



,a-l=logA* (1.74) 
a = log A,. (1.75) 



Solving these two equations for every At we have 
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for all k . 



(1.76) 



Therefore / is a rectangular function taking the same value X for every interval E^, 
that is, / is the rectangular density function 



where L is the Lebesgue measure of the support. 

Then C(f) = 1 is the minimal value for a density function composed of several 
rectangular pieces because, as we know for the example given by Eq. ( 11.68b . C(f) 
is not upper bounded for this kind of distributions. 

Furthermore, for every compactly supported density function g and for every 
£ > 0, it can be shown that near-continuity of C allows to find a t) -neighboring 
density function / of the type given by expression fll.69t verifying | C(f) — C{g) |< 
e. The arbitrariness of the election of e brings us to conclude that C(g) > 1 for every 
probability distribution g. Thus, we can conclude that the minimal value of C is 1 
and it is reached only by the rectangular density functions. 



1.3 Fisher- Shannon Information Product. Some Applications 
1.3.1 Fisher-Shannon information: definition and properties 

The description of electronic properties by means of information measures was in- 
troduced into quantum chemistry by the pioneering works IBTfl IBTl 162 , 63, 64). In- 
particular Shannon entropy l65ll and Fisher information ll66ll have attracted special 
attention in atomic and molecular physics (See e. g. l67l l68l l69l F70l 1711 1721 1731 1741 



[75]|76l[77]|78l[79l[80l[8ll[82][83]^ 89, 90 91 , 92 92113193). It is 



known that these two information measures give complementary descriptions of the 
concentration and uncertainty of the probablility density: S p (I p ) can be seen as a 
global (local) measure of spreading. In this context, the Fisher-Shannon information 
product (that we will define bellow) was found as a link between these information 
measures to improve the characterzation of a probability density function in terms 
of information measures fTSll . 

The single-electron density, the basic variable of the density functional theory 
fl%ll of D-dimensional many-electron systems is given by 



f = X-% L with A 



1 1 



(1-77) 




(1.78) 



where f (ri, ...,!"#) denotes the normalized wavefunction of the N-electron system 
and p (r) is normalized to unity. The spreading of this quantity is best measured by 
the Shannon information entropy 
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S p = - [ p(r)lnp(r)d D r, (1.79) 



or equivalently by the Shannon entropy power 
On the other hand the Fisher information [66 59 1 of p (r) is given by 

12 



Ip= f\ipm dDr 



P(r) 



(1.81) 



The sharpness, concentration or delocalization of the electronic cloud is mea- 
sured by both quantities. It is known that these two information measures give 
complementary descriptions of the smoothness and uncertainty of the electron lo- 
calization: S p and I p are global and local measures of smoothness, respectively 



For completeness let us point out that the aforementioned information measures, 
which refer to an unity-normalized density pi(r) = p(r), are related to the corre- 
sponding measures of the Abnormalized density pjv(r) by 

S PN = -N\nN + NSp and Ip N =NI p (1.82) 

for the Shannon and Fisher quantities, respectively. 

The information product concept P p was originally defined in lf75l as 

Pp = ^J p Ip, (1.83) 

and it was applied in the study of electronic properties of quantum systems during 
last years (See, eg. [75] US |9T] |§2 E31 ISIl Ml USD). Next we will put foward some 
mathematical properties which have been obtained in |[75l [801 11001 1 1 1 1 for the 
Fisher-Shannon information product P p . 



1.3.1.1 Scaling property 

The Fisher information and the Shannon entropy power transform as 

l Py = f-%\ Jp Y = y- [D - x) J P (1.84) 

under scaling of the probability density p(r) by a real scalar factor y; i. e. when 
Py(r) = y D p(7r). This indicates that they are homogeneous density functionals of 
degrees 2 and —2, respectively. Consequently, the information product P p = j^JpIp 
is invariant under this scaling transformation, i. e. 



Pp y - Pp 



(1.85) 
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1.3.1.2 Uncertainty properties 



The Fisher information I p and the Shannon entropy power J p satisfy the uncertainty 
relationship |59l 

~JpIp>l- d-86) 

Remark that when one of the involved quantities decreases near to zero, the other has 
to increase to a large value. Moreover, it is closely linked to the uncertainty relation 



(r 2 }(p 2 ) > where (r 2 ) is defined in terms of the charge position density p(r) 
as (r 2 ) = J r 2 p(r)d D r, and (p 2 ) is given in terms of the momentum density iT(p) 
in an analogous way, where n(p) is defined by means of the Fourier transform of 
•F(ri,...,rtf), <£(pi,...,p;v), as 

H(p) = J |#( P ,P2,...,Pn)| 2 ^P2...</V- d-87) 

The Fisher information has been used as a measure of uncertainty in quantum 
physics (See e. g. [80] [KH] [EU MM DM CES] OK] [[07] QUI [[09] QT0)). It has 
been shown to fulfill the Stam inequalities 111 1 II 

/ P <4(p 2 ); h<A(r 2 ), (1.88) 

and the Cramer-Rao inequalities fl59l[TO0l[Tra[TT2l[TT3ll 

D 2 D 2 
h> W y h> W) d.89) 

for the general single-particle systems. The multiplication of each pair of these in- 
equalities produces 

p^y</p/,<16(r 2 )(p 2 ), (1.90) 

valid for ground and excited states of general systems, which shows the close con- 
nection between the Heisenberg-like uncertainty product and the product of the po- 
sition and momentum Fisher informations. 

Indeed, taken into account 1 /D(r 2 ) > J p 111 141 one has that 

^(p 2 )(r 2 )>^J p I P >l (1.91) 

and 

^(p 2 )(r 2 )>^Pp~K>l. (1.92) 

It is straightforward to show that the equality limit of these two inequalities is 
reached for Gaussian densities. 

An special case is given by a single-particle in a central potential. In this frame- 
work an uncertainty Fisher information relation was obtained in 11011 : 
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(2/ + l)H 



21(1 + 1) 

and Fisher information in position space was derived in |80l as 

I p =A(p 2 )-2(2l + l)\m\(r- 2 ) 



(1-93) 



(1.94) 



where I and m are the orbital and magnetic quantum numbers. Taking into account 
the duality of the position and momentum spaces as well as the separability of the 
wavefunction, one can express the Fisher information of the momentum distribution 
density as 

h = ^{r 2 )-2{2l+\)\m\{p- 2 ). (1.95) 

On the other hand, the radial expectation values (p 2 ) and (r~ 2 ) ((r 2 ) and (p~ 2 )) are 
related HUHD by 



(p 2 )>l(l + l)(r- 2 ), 
(r 2 )>l(l + l)(p- 2 ), 



(1.96) 
(1.97) 



and combining above expressions the fisher uncertainty-like relation dl.93l ) is ob- 
tained. 



1.3.1.3 Nonadditivity properties 

The superadditivity of the Fisher information and the subadditivity of the Shannon 
information of a probability density, can be used to prove l75l that 

I W >NI P (1.98) 

S W <NS P (1.99) 

where 

/• |v|y(n,...,r Af )| 2 | 2 

I w = / -7j—dr 1 ...dr N (1.100) 

J |f(ri,...,rA,)| 2 

and 

S w = J\W(r h ...,r N )\ 2 ]n\W(r 1 ,...,r N )\ 2 dr 1 ...dr N (1.101) 

for general A-fermion systems in three dimensions. The D-dimensional generaliza- 
tion is obvious. We will show the proof below. 

Let p (r ) a probability density on R', that is, p (r) non-negative and / p (r)dr = 1 . 
We will suppose that Fisher information and Shannon information of p(r) exits. 
Corresponding to any orthogonal decomposition R' = R r © R s , t=r+s, the marginal 
densities are given by: 



Pi(x)=/ p(x,yKy, p 2 (y)=/ p(x,yK'x (1.102) 
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then una 

I P >I Pl +Ip2 (1-103) 
property which is known as superadditivity of Fisher information, and 

S P <S Pl +S Pl (1.104) 

which is known as subadditivity of Shannon information. Both inequalities saturate 
whenp(x,y) = p l (x)p 2 (y) HED . 

On the other hand, let us consider an A^-fermion system and denote the /th- 
electron density by 

p,=p(r,) = J \*¥(r l ,...,r i ,...,r N )\ z dri...dri-idr i+ i...dr N , (1.105) 

for i — l,...N. Then, taken into account that the wavefunction is antisymmetric and 
Eq. ( 11.1031 1 and (|1.104| i, the wavefunction Fisher information fullfills 

/IVIffr r )I 2 I 2 N 
l^'Z'r")! 2 dri '" dTN ~ ^ /pi =NIp ' (L1 ° 6) 

and the wavefunction Shannon information fulfills: 

r N 
S w = / |^(n,... ) r JV )| 2 ln|^(ri,...,r JV )| 2 ^ri...rfriv<^5p i =iV5p. (1.107) 

•> i=i 

Inequalities ( 11.106b and ( 11.1071 ) are equalities when |f (ri, ...,rAr)| 2 = p(rx)...p(r^). 

These properties have allowed us to generalize the following uncertainty rela- 
tionships: 

• The Stam's uncertainty relation for wave functions normalized to unity IT751I1 1 II 
is generalized via the inequality ( 11.106t by 

NI p <Iw <4N(p 2 ) (1.108) 

• The Shannon information uncertainty relation for wave functions normalized to 
unity 1 1141 is generalized via inequality j 1 . 107b by 



3AT(l+ln7r)<- / |^( ri ,...,riv)| z ln|^(ri,...,rjv)r^ri..^rjv (1.109) 



\<P(p u ...p N )\ 2 ln\<I>(p u ...,p N )\ 2 dp l ...dp N <N{Sp+S ! t) (1.110) 

where S p (S K ) denotes the Shannon information of the single-particle distribution 
density in position (momentum) space. 
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1.3.2 Fisher-Shannon product as an electronic correlation 
measure 

The Fisher-Shannon information product was earlier employed 1751 as a tool for 
stuying the electron correlation in atomic systems, in particular in two electron 
isoelectronic series. The application of this indicator to the electronic shell struc- 
ture of atoms has received a special attention for systems running from on-electron 
atoms to many-electron ones as those corresponding to the periodic table (see, e.g. 
1911 192119411971 [100)1. 

Many electron systems such as atoms, molecules and clusters show the electron 
correlation phenomenon. This feature has been characterized in terms of the correla- 
tion energy 111 161 , which gives the difference between the exact non-relativistic en- 
ergy and the Hartree-Fock approximation, as well as by some statistical correlation 
coefficients 111 171 . which asses radial and angular correlation in both the position 
and momentum density distributions. Some information-theoretic measures of the 
electron correlation in many electron systems have been proposed during last years 
G5J [US dl9j [1201 HH1 Ell OIlllIMnillinilinTjinHl. Here we will focus on 
the Fisher-Shannon Information Product as a measure of electron correlation. 

The Fisher-Shannon Information Product has been studied in two types of two- 
electron systems ll75l which differ in the Coulomb- and oscillator-like form of the 
electron-nucleus interaction. The Hamiltonian of such a system is 

H = -Iv? - \v\ + V(n) + V(r 2 ) + ] — L- p (1.111) 
2 2 l r i- r 2| 

where V(r,-) denotes the electron-nucleus interaction of the /th-electron. V (r,-) = 
Z/r,- for He-like ions (Z being the nuclear charge) and V (r,-) = A 0)rf for the Hooke 
atoms. The Hooke atom is especially well suited for the understanding of correlation 
phenomena because of its amenability to analytical treatment. 

1.3.2.1 He-like ions 

In the bare coulomb field case (BCF), i. e. without coulombic interelectronic in- 
teraction in the hamiltonian, the ground state wave function of He{Z) is a single 
Slater determinant and the charge density is a hydrogenlike one, so J Pz = ^ 

and I Pz = 4Z 2 , so Pbcf = Kbcf with Kbcf — 1.237333. To consider the inclusion 
of electronic interaction we will work with the 204-terms Hylleraas type functions 
of Koga et al. 111291 for the ground states of H , He, Li+, Be 2+ , B 3+ , and Ne 8+ 
(Z=l-5, 10). 

In Fig. ll,16l we have compared the dependence of the information product P Pz on 
the nuclear charge Z for He-like ions with the bare coulomb field information prod- 
uct. It is apparent the monotonic decrease of P pz when Z increased, asymptotically 
approaching the bare or no-correlation value Pbcf = Kbcf an d showing that the 
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electron correlation effect gradually decreases with respect to the electron-nucleus 
interaction when the nuclear charge of the system is raised up. 




Fig. 1.16 The ratio P Pz /Pbcf of the information product for the He-like ions and the information 
product for bare two-electron atoms as a function of the nuclear charge Z. The points correspond 
to the values of He(Z) ions with Z = 1 — 5 and 10. The solid line has been drawn only to guide the 
eye. 



1.3.2.2 Hooke's atoms 

For the bare oscillator-field case (BOF), it is known that J Pm = 1/ (2o) and I Pm = 
6(0, so that the information product Pbof = F On the other hand the Schrodinger 
equation of the entire Hooke atom can be solved analytically for an infinite set of os- 
cillator frequencies [ 1 30 1 . The use of relative and center of mass coordinates allows 
the Hamiltonian to be separable so that the total wavefunction for singlet states is 
given by f (n, 0i,r2,02) = 4 (R)<P(u)T(ai,02)> where 1(01,02) is the singlet spin 
wave function, % (R) and 4>(u) being the solutions of the Schrodinger equations 

(-iv| + 0)/? 2 )£(R)=£^(R), (1.112) 



(-V 2 u + \(Ou 2 + -)0(u)=E u 0(u), 
4 u 



(1.113) 
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0.1 0.2 0.3 0.4 0.5 0.6 

CO 

Fig. 1.17 The information product P P(i1 /Pbof f° r the Hooke atoms with the oscillator strength 
£0 = 0.5, 0.1, 0.03653727, 0.01734620, 0.009578420, and 0.005841700 and the bare oscilator 
field information product Pbof ■ The solid line has been drawn only to guide the eye. 

respectively, and the total energy E = Er + E u . 

The computed results for the Fisher information and entropy power of these sys- 
tems are shown in Fig. 11.171 for several CO values, (namely, 0.5, 0.1, 0.03653727, 
0.01734620, 0.009578420, and 0.005841700).For these particular values the ground 
state solution can be obtained 11301 as 

£(R)= (^y 4 e- aRl a nd<P(u)=e-^Q n (r) (1.114) 

where Q„(r) is a polynomial whose coefficients can be determined analytically. 

Cioslowski et al 11311 quantify the domains of the weakly correlated regime of 
this system which corresponds to the values of co greater than co c ~ 4.011624 x 
10~ 2 , and the strongly correlated regime that encompasses the values of co smaller 
than co c . 

In Fig. 11.171 we have drawn Pp^/PsoF as a function of the oscillator electron- 
nucleus strength CO. It is apparent that the value of the electron density functional 
Ppa/PBOF (dots) is always bigger than unity, when the electron-electron repulsion 
becomes very small with respect to the oscillator electron-nucleus interaction, the 
points approach to the value 1, indicating the decrease of the relative importance of 
electron correlation when the strength CO is increased. 
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1.3.3 Fisher information for a single particle in a central potential 



As another application, let us consider the Fisher information in the position space 
(for momentum space is analogous) of a single-particle system in a central potential 
V(r), defined by 

|Vp(r)| 2 



P(r) 



-dr 



(1.115) 



where p(r) = |y/(r)| 2 and where \j/(r) is the bound solutions of the Schrodinger 
equation 



\v 2 + V(r) 



\lf(r)=E\jf(r). 

For bounded states the solution of above equation is given by 

Wnim(r) = R ni {r)Yi m (Q) 



(1.116) 



(1.117) 



where R„i{r) is the radial part of the function and Y[ m (Q) is the spherical harmonic 
of order I that is given by 

Y lm (£2 ) = -^ e im ^ & tm (cos 0), (-/ < m < I and O<0<7T,O<(/)<27r) 
•Jin 



(1.118) 

where ®\ m {x) are given in terms of the associated Legendre functions of the first 
kindP/"(x): 



®lm(x) 



121+1 (l-m) 



(1.119) 



2 (l + m) 

So the Fisher information for a single particle in a central potential is given by 



^,„=4/|Vp,f(r)| 2 



V dr 

on the other hand the kinetic energy is given by: 



(P 2 )nlm = J |VV/„/ m (r)| 
V2 R nM 



dR n i{r 
dr 

2 



\Yi m (Q)\' 



dr 



dr, 
(1.120) 



thus 



I Pnlm = 4 (p 2 )nim-2(r- 2 ) nlm (2l + l)\m\ 



dtl.121) 



(1.122) 
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1.3.3.1 Hydrogen atom 

Forthis system the potential is V(r) = — 1/randthe expectation values (p 2 ) n i„, = -K 
and {r 2 ) nlm = (2/+ 2 1>i3 thus 



1.3.3.2 Isotropic harmonic oscillator 

In this case the potential is V(r) = \(0 2 r 2 and the expectation values (p 2 ) n im 
(0(2n + 1 + §) and (r- 2 ) nlm = 



I Pnlm =4co(2n + l+--\m\) (1.124) 



1.4 Applications to Quantum Systems 

1.4.1 Formulas in position and momentum spaces 

Here, we summarize the formulas and the nomenclature that will use in all this 
section. 

The measure of complexity C has been defined as 

C = HD, (1.125) 

where H represents the information content of the system and D gives an idea of 
how much concentrated is its spatial distribution. 

The simple exponential Shannon entropy, in the position and momentum spaces, 
takes the form, respectively, 

H, =e s > , H p = e s P, (1.126) 

where S r and S p are the Shannon information entropies, 

5 r = -|p(r)logp(r)dr, S p = -|y(p) logy(p) dp , (1.127) 

and p(r) and y(p) are the densities normalized to 1 of the quantum system in posi- 
tion and momentum spaces, respectively. 
The disequilibrium is: 
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D r = J p 2 (r) dr , D p = J f(p) dp , (1.128) 

In this manner, the final expressions for C in position and momentum spaces are: 

C r =H r D r , C p = H p D p . (1.129) 

Second, the Fisher-Shannon information, P, in the position and momentum 
spaces, is given respectively by 

P r =J r I r , P P =J P -I P , (1.130) 

where the first factor 

/= — e 2s '/ 3 / = — e 2 V3 (1131) 

is a version of the exponential Shannon entropy, and the second factor 

, [VpW] 2 , , f [vy(p)] 2 , r11 „, 



is the Fisher information measure, that quantifies the narrowness of the probability 
density. 



1.4.2 TheH-atom 



The atom can be considered a complex system. Its structure is determined through 
the well established equations of Quantum Mechanics 0132111331 . Depending on the 
set of quantum numbers defining the state of the atom, different conformations are 
available to it. As a consequence, if the wave function of the atomic state is known, 
the probability densities in the position and the momentum spaces are obtained, and 
from them, the different statistical magnitudes such as Shannon and Fisher informa- 
tions, different indicators of complexity, etc., can be calculated. 

These quantities enlighten new details of the hierarchical organization of the 
atomic states. In fact, states with the same energy can display, for instance, different 
values of complexity. This is the behavior shown by the simplest atomic system, that 
is, the hydrogen atom (H-atom). Now, we present the calculations for this system 

The non-relativistic wave functions of the //-atom in position space (r = (r, Q), 
with r the radial distance and Q the solid angle) are: 

f„,/. m (r)=/?„,/(r)F /im (i2), (1.133) 

where R n ,i{r) is the radial part and Yi >m (Q) is the spherical harmonic of the atomic 
state determined by the quantum numbers (n,l,m). The radial part is expressed as 
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"(n-Z-1)!" 


" 2 (!)' 
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(« + /)! 









11351 

MO = 4 ■ 



being L«(f) the associated Laguerre polynomials. Atomic units are used here. 

The same functions in momentum space (p = (p,Q), with p the momentum 
modulus and Q. the solid angle) are: 

where the radial part R n j(p) is now given by the expression HI 341 
- , , \2 (n-/-l)n x /2 



7T (« + /)! 



n 2 ? 2/+2„ "P W+l f »V-1 \ 

(«V+iy+ 2 v '->y+ij 



(1.136) 

with C«(f) the Gegenbauer polynomials. 

Taking the former expressions, the probability density in position and momentum 
spaces, 

P(r) = I S^/, m (r) | 2 , 7(p) = | %,, m (p) I 2 , d-137) 

can be explicitly calculated. From these densities, the statistical complexity and the 
Fisher-Shannon information are computed. 

C r and C p (see expression ( 11.129b ) are plotted in Fig. 11.181 as function of the 
modulus of the third component m of the orbital angular momentum / for different 
pairs of (n,l) values. The range of the quantum numbers is: n > 1, < I < n — 1, 
and — / < m < I. Fig. 11.1 8f a~) shows C r for n = 15 and Fig. 11.181 b) shows C r for 
n = 30. In both figures, it can be observed that C, splits in different sets of discrete 
points. Each one of these sets is associated to a different / value. It is worth to note 
that the set with the minimum values of C r corresponds just to the highest /, that is, 
l = n — l. The same behavior can be observed in Figs. ll.18l c) and ll,18f d) for C p . 

Fig. |1.19| shows the calculation of P r and P p (see expression dl.l301 l) as function 
of the modulus of the third component m for different pairs of («,/) values. The 
second factor, I r or I p , of this indicator can be analytically obtained in both spaces 
(position and momentum). The results are l80l : 

/,. = 4fl- M Y (1.138) 

I p = 2n 2 (5« 2 + l-3/(/+l)-(8«-3(2/+l)) \m\) . (1.139) 

In Fig. [TT9l a). P, is plotted for n = 15, and P, is plotted for n = 30 in Fig. [TT9l b). 
Here P, also splits in different sets of discrete points, showing a behavior parallel 
to the above signaled for C (Fig. 11.181 . Each one of these sets is also related with a 
different I value. It must be remarked again that the set with the minimum values of 
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Fig. 1.18 Statistical complexity in position space, C,-, and momentum space, C„, vs. \m\ for differ- 
ent (n, /) values in the hydrogen atom. C r for (a) n = 15 and (b) n = 30. C p for (c) « = 15 and (d) 
n — 30. All values are in atomic units. 



P r corresponds just to the highest /. In Figs. ll.19l c) and ll,19f d). the same behavior 
can be observed for P p . 

Then, it is put in evidence that, for a fixed level of energy n, these statistical 
magnitudes take their minimum values for the highest allowed orbital angular mo- 
mentum, / = n — 1 . It is worth to remember at this point that the mean radius of an 
(«,/ = n — l) orbital, < r >„j, is given by 111351 

<r >„,/=„_!= » 2 (! + ^)' (1-140) 

that tends, when n is very large, to the radius of the nth energy level, rg /, r = n 2 , 
of the Bohr atom. The radial part of this particular wave function, that describes the 
electron in the (n, I = n— 1) orbital, has no nodes. In fact, if we take the standard de- 
viation, (Ar) =< (r— < r >) 2 > 1 / 2 , of this wave function, (Ar) = ny/2n + 1/2, the 
ratio (Ar)/ < r > becomes l/v2« for large n. This means that the spatial configu- 
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ration of this atomic state is like a spherical shell that converges to a semiclassical 
Bohr-like orbit when n tends to infinity. These highly excited //-atoms are referred 
as Rydberg atoms, that have been intensively studied [ 1 36 1 for its importance in ar- 
eas as astrophysics, plasma physics, quantum optics, etc., and also in studies of the 
classical limit of quantum mechanics Ml 371 . 
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Fig. 1.19 Fisher-Shannon information in position space, P r , and momentum space, P p , vs. \m\ for 
different (n, I) values in the hydrogen atom. P r for (a) n = 15 and (b) n = 30. P r for (c) n = 15 and 
(d) n = 30. All values are in atomic units. 



We conclude this section by remarking that the minimum values of these statis- 
tical measures calculated from the quantum wave functions of the //-atom enhance 
our intuition by selecting just those orbitals that for a large principal quantum num- 
ber converge to the Bohr-like orbits in the pre-quantum image. Therefore, these 
results show that insights on the structural conformation of quantum systems can be 
inferred from these magnitudes, as it can also be seen in the next sections. 
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1.4.3 The quantum harmonic oscillator 



As suggested in the previous section, a variational process on the statistical measures 
calculated in the //-atom could select just those orbitals that in the pre-quantum im- 
age are the Bohr-like orbits. Now, we show that a similar behavior for the statistical 
complexity and Fisher-Shannon information is also found in the case of the isotropic 
quantum harmonic oscillator ||9T1 . 

We recall the three-dimensional non-relativistic wave functions of this system 
when the potential energy is written as V(r) = A 2 r 2 /2, with A a positive real con- 
stant expressing the potential strength. In the same way as in the //-atom (Eq. 
( 11.1331 ). these wave functions in position space (r = (r,Q), with r the radial dis- 
tance and Q the solid angle) are: 



(1.141) 



where R„j(r) is the radial part and F/ m (i2) is the spherical harmonic of the quantum 
state determined by the quantum numbers (n,l, m). Atomic units are used here. The 
radial part is expressed as 11 1 3 81 



2n!A'+ 3 / 2 
r(n + 1 + 3/2) 



I 1 / 2 



r' C l/2 (Xr 2 ) 



(1.142) 



where L„ (t) are the associated Laguerre polynomials. The levels of energy are given 
by 

E nJ = A (2« + / + 3/2) = A (e n> i + 3/2) , ( 1 . 143) 

where n = 0, 1,2,- ■■ and I = 0, 1,2,- ■■, Let us observe that e n i = 2n + l. Thus, 
different pairs of (n,l) can give the same e n /, and then the same energy E n /. 

The wave functions in momentum space (p = (p,Q), with p the momentum 
modulus and C2 the solid angle) present the same form as in the //-atom (Eq. ll. 1351 ): 



where the radial part R„j(p) is now given by the expression [ 138 1 



RnAP) 



2n\X- l -y 2 
r{n + 1 + 3/2) 



1/2 



p l e-h L l n +l l\p 2 /X) 



(1.144) 



(1.145) 



Taking the former expressions, the probability density in position and momentum 
spaces, 



n(P) = I %,l,n(P) 



(1.146) 



can be explicitly calculated. From these densities, the statistical complexity (see 
expression (11.129b ) and the Fisher-Shannon information (see expression ( 1 1.1 301 )) 
are computed. It is shown in section 11.4.3.11 that these quantities are independent 
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Fig. 1.20 Statistical complexity in position space, C r , and momentum space, C p , vs. \m\ for dif- 
ferent energy ^/-values in the quantum isotropic harmonic oscillator for (a) e„j = 15 and (b) 
e„j = 30. Recall that C,- = C p . All values are in atomic units. 



of A, the potential strength, and also that they are the same in both position and 
momentum spaces, i.e. C r = C p and P, = P p . 

In Fig. 1 1 .201 C r (or C p ) is plotted as function of the modulus of the third compo- 
nent m, —I < m< I, of the orbital angular momentum / for different I values with 
a fixed energy. That is, according to expression (11.143b , the quantity e n \ =2n + l is 
constant in each figure. Fig. 11.201' a") shows C r for e„ / = 15 and Fig. ll.20l b) shows 
C, for e„ J = 30. In both figures, it can be observed that C, splits in different sets of 
discrete points. Each one of these sets is associated to a different / value. It is worth 
noting that the set with the minimum values of C r corresponds just to the highest I, 
that is, / = 15 in Fig. [L20l a) and I = 30 in Fig. lQDT b). 

Fig. 1 1.21 1 shows P as function of the modulus of the third component m for dif- 
ferent pairs of (e„ j =2n + l,l) values. The second factor, /, or I p , of this indicator 
can be analytically obtained in both spaces (position and momentum) 15D1 : 

I r = A{2n + l + 3/2-\m\)X, (1.147) 
I p = 4(2« + / + 3/2- |m|)A _1 . (1.148) 

Let us note that /, and I p depend on A, although the final result for P r and P p are non 
A-dependent (see section [T.4.3.U . In Fig. ll.2ll a). P, (or P p ) is plotted for e„ / = 15, 
and P r is plotted for e n \ = 30 in Fig. ll.2U b). Here, P,- also splits in different sets 
of discrete points, showing a behavior similar to that of C in Fig. 11.201 Each one of 
these sets is related with a different I value, and the set with the minimum values of 
P r also corresponds just to the highest /, that is, / = 15 and / = 30, respectively. 

As in the //-atom, we also see here that, for a fixed level of energy, let us say 
e n j = 2n + 1, these statistical quantities take their minimum values for the highest 
allowed orbital angular momentum, / = e n j. It is worth remembering at this point 
that the radial part of this particular wave function, that describes the quantum sys- 
tem in the (n = 0,/ = e„/) orbital, has no nodes. This means that the spatial con- 
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Fig. 1.21 Fisher-Shannon information in position space, P r , and momentum space, P p , vs. \m\ for 
different energy e„,/-values in the quantum isotropic harmonic oscillator, for (a) e„j = 15 and (b) 
e„j = 30. Recall that P r = P p . All values are in atomic units. 



figuration of this state is, in some way, a spherical-like shell. In section fT.4.3.21 the 
mean radius of this shell, < r >„,/.„„ is found for the case (n =0,1 = e„i,m). This 
is: 

< r >n=0,l=e n , h m=< r >, I=0 j = ,„,~ y/x~ 1 (e nJ + 1 ) (l + ©(e^ 1 )) , (1.149) 

that tends, when e n j ^> 1, to the radius of the Nth energy level, = \/X~ l (N + 1), 
taking = e,,./ in the Bohr-like picture of the harmonic oscillator (see section 
11.4.3.21 1. 

Then, we can remark again that the minimum values of the statistical measures 
calculated from the wave functions of the quantum isotropic harmonic oscillator 
also select just those orbitals that in the pre-quantum image are the Bohr-like orbits. 



1.4.3.1 Invariance of C and P under rescaling transformations 



Here, it is shown that the statistical complexities C, and C p are equal and indepen- 
dent of the strength potential, X, for the case of the quantum isotropic harmonic 
oscillator. Also, the same behavior is displayed by P r and P p . 

For a fixed set of quantum numbers, (n,l,m), let us define the normalized proba- 
bility density p(t): 



P(0 



2n\ 



t 21 e-' Z 



r'+l/2/,2 



it 1 ) [YiA^Y 



r(n + 1 + 3/2) 

From expressions ( I1.14U . (11.1421 and ( 11.146l l. it can be obtained that 



(1.150) 



p A (r)=A 3 / 2 p(A I /2 r ), 



(1.151) 
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where p A is the normalized probability density of expression (11.146b . Now, it is 
straightforward to find that 

H r (p x )=X-^ 2 H(p), (1.152) 

and that 

D r (p A )=A 3 / 2 D(p). (1.153) 

Then, 

C r ( Pl )=C( P ), (1.154) 

and the non A -dependence of C r is shown. 

To show that C, and C p are equal, let us note that, from expressions (11. 1441 ). 
( 11.145b and (11.146b , the normalized probability density "fx (p) for the same set of 
quantum numbers (n,l,m) can be written as 



n(p)=X-V 2 p(l-V 2 p). (1.155) 

H p (y x )=X i ' 2 H(p) 1 (1.156) 

D p ( n )=X-V 2 D(p). (1.157) 

C p (n)=C(P), (1.158) 

and the equality of C r and C p , and their non A -dependence are shown. 

Similarly, from expressions ( 11.1301 ), dl-131b . ( 11.147b and ( 11.148b . it can be found 
that P r = P p , and that these quantities are also non A -dependent. 



Now, it is found that 

and that 

Then, 



1.4.3.2 Bohr-like orbits in the quantum isotropic harmonic oscillator 

Here, the mean radius of the orbital with the lowest complexity is calculated as 
function of the energy. Also, the radii of the orbits in the Bohr picture are obtained. 

The general expression of the mean radius of a state represented by the wave 
function %j, m is given by 



< r >n,l,m = < r >„,/= 



1 



r(n + / + 3/2) A 1 / 2 Jo 



t ,+l e~' 



L' n ^ 2 (t) 



dt. (1.159) 



For the case of minimum complexity (see Fig. |1.20| or |1.21b , the state has the quan- 
tum numbers (n = 0,1 = e„ [). The last expression (11. 159b becomes: 



< r > n =0,l=e„ r 



(«»,« + 1)1 



r( en , + 3/2)AV2 ' 



(1.160) 



that, in the limit e n j ^> 1, simplifies to expression (11. 149b : 
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<^> n =o,/= e „,,»i- ^X-'{e n ., + \)(\+&{e-])y (1.161) 

Now we obtain the radius of an orbit in the Bohr-like image of the isotropic 
harmonic oscillator. Let us recall that this image establishes the quantization of the 
energy through the quantization of the classical orbital angular momentum. So, the 
energy £ of a particle of mass m moving with velocity v on a circular orbit of radius 
r under the harmonic potential V (r) = mX 2 r 2 /2 is: 

E = -ml 2 r 2 + -mv 2 . (1.162) 
2 2 

The circular orbit is maintained by the central force through the equation: 

2 

— = mX 2 r. (1.163) 
r 

The angular momentum takes discrete values according to the condition 

mvr= {N+l)h (N = 0,1,2,...). (1.164) 

Combining the last three equations dl.162t - dl.164t . and taking atomic units, m = 
k = 1, the radius rm of a Bohr-like orbit for this system is obtained 



r N = y Jk- 1 (N+l) (AT = 0,1,2,...). (1.165) 

Let us observe that this expression coincides with the quantum mechanical radius 
given by expression (11.161b when e n \ = N for N ^> 1. 



1.4.4 The square well 

Statistical complexity has been calculated in different atomic systems, such as in 
the H atom (Sec. I1.4.2t and in the quantum harmonic oscillator (Sec. I1.4.3t . The 
behavior of this statistical magnitude in comparison with that of the energy displays 
some differences. Among other applications, the energy has a clear physical mean- 
ing II 1321 and it can be used to find the equilibrium states of a system. In the same 
way, it has also been shown that the complexity can give some insight about the 
equilibrium configuration in the ground state of the H£ molecule ||98l . In this case, 
Montgomery and Sen have reported that the minimum of the statistical complex- 
ity as a function of the internuclear distance for this molecule is an accurate result 
comparable with that obtained with the minimization of the energy. This fact could 
suggest that energy and complexity are two magnitudes strongly correlated for any 
quantum system. But this is not the general case. See, for example, the behavior 
of both magnitudes in the previous sections for the H-atom and for the quantum 
isotropic harmonic oscillator. In both systems, the degeneration of the energy is 



1 .4 Applications to Quantum Systems 



57 



split by the statistical complexity, in such a way that the minimum of complexity for 
each level of energy is taken on the wave function with the maximum orbital angular 
momentum. Therefore, energy and complexity are two independent variables. 

In this section, we wonder if there exists a quantum system where degeneration of 
the complexity can be split by the energy. The answer will be affirmative II 1391 . We 
show it in two steps. First, a new type of invariance by replication for the statistical 
complexity is established, and, second, it is seen that the energy eingestates of the 
quantum infinite square well fulfill the requirements of this kind of invariance. From 
there, it is revealed that the degeneration of complexity in this quantum system is 
broken by the energy. 

Different types of replication can be defined on a given probability density. One 
of them was established in Ref. |53l . Here, a similar kind of replication is presented, 
in such a manner that the complexity C of m replicas of a given distribution is equal 
to the complexity of the original one. Thus, if R represents the support of the density 
function p(x), with J R p(x)dx = 1, take « copies p m (x), m = l,--- ,n, of p(x), 

Pm(x) = p(n(x- X m )) , \<m<n, (1.166) 

where the supports of all the p m {x), centered at X' m s points, m = 1, •••,«, are all 
disjoint. Observe that f R p m (x)dx = i, what makes the replicas union 

n 

1n(x) = Y j p m (x) (1.167) 

1=1 

to be also a normalized probability distribution, / R q„ (x) dx = 1 . For every p m (x), a 
straightforward calculation shows that the Shannon entropy is 

S(p m ) = -S(p), (1.168) 
n 

and the disequilibrium is 

D( Pm ) = -D(p). (1.169) 
n 

Taking into account that the m replicas are supported on disjoint intervals on R, 
we obtain 

S(q n )=S(p), (1.170) 
D(q n ) = D(p). (1.171) 
Then, the statistical complexity (C = e s ■ D) is 

C(q n )=C(p), (1.172) 

and this type of invariance by replication for C is shown. 

Let us see now that the probability density of the eigenstates of the energy in the 
quantum infinite square well display this type of invariance. The wave functions rep- 
resenting these states for a particle in a box, that is confined in the one-dimensional 



58 



1 Statistical Complexity and Fisher-Shannon Information. Applications 



interval [0,L], are given by Ml 401 



<Pk{x) 




(1.173) 



Taking p(x) as the probability density of the fundamental state (k 



p(x)=\(pi(x) | 2 , 



(1.174) 



the probability density of the kth excited state, 



=1 <Pk(x) | 2 , 



(1.175) 



can be interpreted as the union of k replicas of the fundamental state density, p(x), 
in the k disjoint intervals \(m — l)L/k,mL/k], with m = 1,2,. ..,k. That is, we find 
expression (11.167b , q^{x) = £* =1 p m (x), with 



where in this case the X' m s of expression (11.166b are taken as (m— l)L/k. Therefore, 
we conclude that the complexity is degenerated for all the energy eigenstates of the 
quantum infinite square well. Its value can be exactly calculated. Considering that L 
is the natural length unit in this problem, we obtain 



In the general case of a particle in a cZ-dimensional box of width L in each dimension, 
it can also be verified that complexity is degenerated for all its energy eigenstates 
with a constant value given by C = (3/e) d . 

Here we have shown that, in the same way that the complexity breaks the energy 
degeneration in the H-atom and in the quantum isotropic harmonic oscillator, the 
contrary behavior is also possible. In particular, the complexity is constant for the 
whole energy spectrum of the of-dimensional quantum infinite square well. This 
result is due to the same functional form displayed by all the energy eigenstates of 
this system. Therefore, it suggests that the study of the statistical complexity in a 
quantum system allows to infer some properties on its structural conformation. 



1.4.5 The periodic table 

The use of these statistical magnitudes to study the electronic structure of atoms 
is another interesting application J63] |87] MB E2 EH EU [145] [146) . The basic 
ingredient to calculate these statistical indicators is the electron probability density, 
p(r), that can be obtained from the numerically derived Hartree-Fock atomic wave 




(1.176) 



C(p)=C( ft ) = - = 1.1036... 



(1.177) 



e 
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function in the non-relativistic case 11411 11421 . and from the Dirac-Fock atomic 
wave function in the relativistic case 111431 . The behavior of these statistical quan- 
tifiers with the atomic number Z has revealed a connection with physical measures, 
such as the ionization potential and the static dipole polarizability 11871 . All of them, 
theoretical and physical magnitudes, are capable of unveiling the shell structure of 
atoms, specifically the closure of shells in the noble gases. Also, it has been observed 
that statistical complexity fluctuates around an average value that is non-decreasing 
as the atomic number Z increases in the non-relativistic case 1142111431 . This aver- 
age value becomes increasing in the relativistic case 01431 . This trend has also been 
confirmed when the atomic electron density is obtained with a different approach 
II 1471 . In another context where the main interactions have a gravitational origin, as 
it is the case of a white dwarf, it has also been observed that complexity grows as 
a function of the star mass, from the low-mass non-relativistic case to the extreme 
relativistic limit. In particular, complexity for the white dwarf reaches a maximum 
finite value in the Chandrasekhar limit as it was calculated by Sanudo and Lopez- 
Ruiz 0481 . 



t 1 i 1 | 1 1 r 1 1 1 p 1 1 1 1 1 r 1 1 1 r 




Fig. 1.22 Statistical complexity, C, vs. Z in the non relativistic case (C NR ). The dashed lines indi- 
cate the position of noble gases. For details, see the text. 

An alternative method to calculate the statistical magnitudes can be used when 
the atom is seen as a discrete hierarchical organization. The atomic shell structure 
can also be captured by the fractional occupation probabilities of electrons in the 
different atomic orbitals. This set of probabilities is here employed to evaluate all 
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Fig. 1.23 Statistical complexity, C, vs. Z in the relativistic case (C R ). The comments given in Fig. 
I1.22l are also valid here. 

these quantifiers for the non-relativistic (NR) and relativistic (R) cases. In the NR 
case, a non-decreasing trend in complexity as Z increases is obtained and also the 
closure of shells for some noble gases is observed If94l ll49l . 

For the NR case, each electron shell of the atom is given by (nl) w 111501 . where 
n denotes the principal quantum number, I the orbital angular momentum (0 < I < 
n — 1) and w is the number of electrons in the shell (0 < w < 2(21 + 1)). For the R 
case, due to the spin-orbit interaction, each shell is split, in general, in two shells 
|[T5T1 : (nlj-) w -, (nlj+) w +, where j± =l± 1/2 (for / = only one value of j is 
possible, j = j + = 1 /2) and < w± < 2j± + 1. As an example, we explicitly give 
the electron configuration of Ar(Z = 18) in both cases, 

Ar(NR) : (ls) 2 (2s) 2 (2p) 6 (3s) 2 (3p) 6 , (1.178) 

Ar(R) : (lsl/2) 2 (2sl/2) 2 (2pl/2) 2 (2p3/2)\3sl/2) 2 (3pl/2) 2 (3 P 3/2) 4 . (1.179) 

For each atom, a fractional occupation probability distribution of electrons in 
atomic orbitals {p^}, k = 1,2, ... ,77, being 77 the number of shells of the atom, 
can be defined. This normalized probability distribution {pk} (T.Pk = 1) is easily 
calculated by dividing the superscripts w± (number of electrons in each shell) by Z, 
the total number of electrons in neutral atoms, which is the case we are considering 
here. The order of shell filling dictated by nature [150] has been chosen. Then, from 
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this probability distribution, the different statistical magnitudes (Shannon entropy, 
disequilibrium, statistical complexity and Fisher-Shannon entropy) is calculated. 

In order to calculate the statistical complexity C = H D, with H = e s , we use the 
discrete versions of the Shannon entropy S and disequilibrium D: 

n 

S = - J>tlogp t , (1.180) 

k=\ 

n 

d= £( w -i/n) 2 . (1.181) 

k=\ 

To compute the Fisher-Shannon information, P = J I, with J = ^ e 2S ' 3 , the dis- 
crete version of / is defined as (94] 11491 

I= y (PM-Pk) 2 (1182) 

where pn+i — is taken. 




The statistical complexity, C, as a function of the atomic number, Z, for the NR 
and R cases for neutral atoms is given in Figs. 11.221 and 11.231 respectively. It is 
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Fig. 1.25 Fisher-Shannon entropy, P, vs. Z, in the relativistic case (P R ). The comments given in 
Fig. ll.24l are also valid here. 

observed in both figures that this magnitude fluctuates around an increasing average 
value with Z. This increasing trend recovers the behavior obtained by using the 
continuous quantum-mechanical wave functions 1 1421 11431 . A shell-like structure is 
also unveiled in this approach by looking at the minimum values of C taken on the 
noble gases positions (the dashed lines in the figures) with the exception of Ne{Z = 
10) and Ar(Z =18). This behavior can be interpreted as special arrangements in the 
atomic configuration for the noble gas cases out of the general increasing trend of C 
with Z. 

The Fisher-Shannon entropy, P, as a function of Z, for the NR and R cases in 
neutral atoms is given in Figs. 11.241 and 11.251 respectively. The shell structure is 
again displayed in the special atomic arrangements, particularly in the R case (Fig. 
I1.251 l where P takes local maxima for all the noble gases (see the dashed lines on 
Z = 2, 10, 18,36,54,86). The irregular filling (i.f.) of s and d shells lfl50l is also 
detected by peaks in the magnitude P, mainly in the R case. In particular, see the 
elements Cr and Cu (i.f. of As and 3d shells); Nb, Mo, Ru, Rh, and Ag (i.f. of 5s and 
Ad shells); and finally Pt and Au (i.f. of 6s and 5d shells). Pd also has an irregular 
filling, but P does not display a peak on it because the shell filling in this case does 
not follow the same procedure as the before elements (the 5s shell is empty and the 
5d is full). Finally, the increasing trend of P with Z is clearly observed. 

Then, it is found that P, the Fisher-Shannon entropy, in the relativistic case (Fig. 
II. 25b reflects in a clearer way the increasing trend with Z, the shell structure in noble 
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gases, and the irregular shell filling of some specific elements. The same method that 
uses the fractional occupation probability distribution is applied in the next section 
to another many particle system, the atomic nucleus, that has also been described 
by a shell model. 



1.4.6 Magic numbers in nuclei 

Nucleus is another interesting quantum system that can be described by a shell 
model 11521 . In this picture, just as electrons in atoms, nucleons in nuclei fill in 
the nuclear shells by following a determined hierarchy. Hence, the fractional occu- 
pation probabilities of nucleons in the different nuclear orbitals can capture the nu- 
clear shell structure. This set of probabilities, as explained in the above section, can 
be used to evaluate the statistical quantifiers for nuclei as a function of the number 
of nucleons. In this section, by following this method, the calculation of statistical 
complexity and Fisher-Shannon information for nuclei is presented 11531 . 

The nuclear shell model is developed by choosing an intermediate three-dimensional 
potential, between an infinite well and the harmonic oscillator, in which nucle- 
ons evolve under the Schrodinger equation with an additional spin-orbit interaction 
11521 . In this model, each nuclear shell is given by (nlj) w , where / denotes the or- 
bital angular momentum (/ = 0, 1,2, . . .), n counts the number of levels with that / 
value, j can take the values / + 1/2 and / — 1/2 (for 1 = only one value of j is pos- 
sible, j = 1 /2), and w is the number of one-type of nucleons (protons or neutrons) 
in the shell (0 < w < 2j + 1). 

As an example, we explicitly give the shell configuration of a nucleus formed by 
Z = 20 protons or by N = 20 neutrons. In both cases, it is obtained 11521 : 



When one-type of nucleons (protons or neutrons) in the nucleus is considered, 
a fractional occupation probability distribution of this type of nucleons in nuclear 
orbitals {pk}, k = 1,2, ... , IT, being IT the number of shells for this type of nucleons, 
can be defined in the same way as it has been done for electronic calculations in the 
atom in the previous section. This normalized probability distribution {p^} (£<Pk = 
1 ) is easily found by dividing the superscripts w by the total of the corresponding 
type of nucleons (Z or N). Then, from this probability distribution, the different 
statistical magnitudes (Shannon entropy, disequilibrium, statistical complexity and 
Fisher-Shannon entropy) by following expressions dl.180Hl.182t are obtained. 

The statistical complexity, C, of nuclei as a function of the number of nucleons, 
Z or N, is given in Fig. 11.261 Here we can observe that this magnitude fluctuates 
around an increasing average value with Z or N. This trend is also found for the 
electronic structure of atoms (see previous section), reinforcing the idea that, in 
general, complexity increases with the number of units forming a system. However, 




: (M/2) 2 (lp3/2) 4 (lpl/2) 2 (W5/2) 6 (2sl/2) 2 (W3/2) 4 . (1.183) 
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Fig. 1.26 Statistical complexity, C, vs. number of nucleons, Z or iV. The dashed lines indicate the 
positions of magic numbers {2, 8, 20, 28, 50, 82, 126, 184}. For details, see the text. 

the shell model supposes that the system encounters certain ordered rearrangements 
for some specific number of units (electrons or nucleons). This shell-like structure 
is also unveiled by C in this approach to nuclei. In this case, the extremal values 
of C are not taken just on the closed shells as happens in the noble gases positions 
for atoms, if not that they appear to be in the positions one unit less than the closed 
shells. 

The Fisher-Shannon entropy, P, of nuclei as a function of Z ox N is given in 
Fig. 11.271 It presents an increasing trend with Z or N. The spiky behavior of C pro- 
voked by the nuclear shell structure becomes smoother for P, that presents peaks 
(changes in the sign of the derivative) only at a few Z or N, concretely at the num- 
bers 2,6,14,20,28,50,82,126,184. Strikingly, the sequence of magic numbers is 
{2,8,20,28,50,82,126,184} (represented as dashed vertical lines in the figures). 
Only the peaks at 6 and 14 disagree with the sequence of magic numbers, what 
could be justified by saying that statistical indicators work better for high numbers. 
But in this case, it should be observed that the carbon nucleus, C^Tg , and the silicon 
nucleus, Si^Zu^ apart from their great importance in nature and industry, they are 
the stable isotopes with the greatest abundance in the corresponding isotopic series, 
98.9% and 92.2%, respectively. 
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Fig. 1.27 Fisher-Shannon entropy, P, vs. the number of nucleons, Z or N. The dashed lines indicate 
the positions of magic numbers {2. 8, 20, 28, 50, 82, 126, 184}. For details, see the text. 



Then, the increasing trend of these statistical magnitudes with Z or N, and the 
reflect of the shell structure in the spiky behavior of their plots are found when using 
for their calculation the fractional occupation probability distribution of nucleons, 
Z or N. It is worth to note that the relevant peaks in the Fisher-Shannon information 
are revealed to be just the series of magic numbers in nuclei. This fact indicates 
again that these statistical indicators are able to enlighten some structural aspects of 
quantum many-body systems. 
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